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Search Results - Record(s) 1 through 3 of 3 returned. 



□ 1. Document ID: US 6615199 Bl 
Using default format because multiple data bases are involved. 

L4 : Entry 1 of 3 File: USPT 



Sep 2, 2003. 



US-PAT-NO: 6615199 

DOCUMENT-IDENTIFIER: US 6615199 Bl 

** See image for Certificate of Correction ** 

TITLE: Abstraction factory in a base services pattern environment 
DATE-ISSUED: September 2, 2003 
I NVENTOR- I N FORMAT I ON : 

NAME CITY STATE ZIP CODE COUNTRY 

Bowman-Amuah; Michel K. Colorado Springs CO 

US-CL-CURRENT: 706/50 



US-PAT-NO: 5806056 

DOCUMENT-IDENTIFIER: US 5806056 A 

TITLE: Expert system and method employing hierarchical knowledge base, and 
interactive multimedia/hypermedia applications 

DATE-ISSUED: September 8, 1998 

INVENTOR-INFORMATION: 

NAME CITY STATE ZIP CODE COUNTRY 

Hekmatpour; Amir Burlington VT 

US-CL-CURRENT: 706/50; 706/45, 706/46, 706/61 




□ 2. Document ID: US 5806056 A 

L4: Entry 2 of 3 



File: USPT 



Sep 8, 1998 
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□ 3. Document ID: US 5720007 A 

L4: Entry 3 of 3 File: USPT Feb 17, 1998 

US-PAT-NO: 5720007 

DOCUMENT-IDENTIFIER: US 5720007 A 

** See image for Certificate of Correction ** 

TITLE: Expert system and method employing hierarchical knowledge base, and 
interactive multimedia/hypermedia applications 

DATE-ISSUED: February 17, 1998 

INVENTOR-INFORMATION : 

NAME CITY STATE ZIP CODE COUNTRY 

Hekmatpour; Amir Burlington VT 



US-CL-CURRENT: 706/50; 706/11, 706/46 
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Derwent World Patents Index 
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Search Results - Record(s) 1 through 9 of 9 returned. 



□ 1. Document ID: US 6622136 B2 
Using default format because multiple data bases are involved. 

L5: Entry 1 of 9 File: USPT 



Sep 16, 2003 



US-PAT-NO: 6622136 

DOCUMENT-IDENTIFIER: US 6622136 B2 

TITLE: Interactive tool for semi-automatic creation of a domain model 
DATE-ISSUED: September 16, 2003 
INVENTOR- INFORMATION : 

NAME CITY STATE ZIP CODE COUNTRY 

Russell; Dale William Palatine IL 

US-CL-CURRENT: 706/45; 706/50, 706/61 



US-PAT-NO: 6615199 

DOCUMENT-IDENTIFIER: US 6615199 Bl 

** See image for Certificate of Correction ** 

TITLE: Abstraction factory in a base services pattern environment 
DATE-ISSUED: September 2, 2003 
INVENTOR- IN FORMAT I ON : 

NAME CITY STATE ZIP CODE COUNTRY 

Bowman-Amuah; Michel K. Colorado Springs CO 

US-CL-CURRENT: 706/50 
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□ 2. Document ID: US 6615199 Bl 

L5: Entry 2 of 9 



File: USPT 



Sep 2, 2003 
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□ 3. Document ID: US 6356885 B2 

L5: Entry 3 of 9 



File: USPT 



Mar 12, 2002 



US-PAT-NO: 6356885 

DOCUMENT- IDENTIFIER : US 6356885 B2 

TITLE: Network model for alarm correlation 

DATE-ISSUED: March 12, 2002 



INVENTOR- INFORMATION : 
NAME 

Ross; Niall 

White; Anthony Richard Phillip 



CITY STATE ZIP CODE COUNTRY 

Nr Great Dunmow GB 
Bishops Stortford GB 



US-CL-CURRENT: 706/45; 706/47, 706/150, 706/61, 706/916, 706/917 



Citation | Ffont Review I Classification I Date I Reference 



□ 4. Document ID: US 6282531 Bl 

L5: Entry 4 of 9 



File: USPT 



Aug 28, 2001 



US-PAT-NO: 6282531 
DOCUMENT-IDENTIFIER: 



US 6282531 Bl 



TITLE: System for managing applied knowledge and workflow in multiple dimensions 
and contexts 

DATE-ISSUED: August 28, 2001 



INVENTOR- INFORMATION: 






NAME 


CITY 


STATE 


Haughton; John F. 


Westf ord 


MA 


Merenyi; Robert C. 


Lexington 


MA 


Harris; Jeff 


Hampton 


NH 


Sherman; Alexander 


Brookline 


MA 



ZIP CODE 



COUNTRY 



US-CL-CURRENT: 706/50; 706/46, 706/59 



Citation | Front | Review Classification Date Referents 
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□ 5. Document ID: US 5806056 A 

L5: Entry 5 of 9 File: USPT Sep 8, 1998 

US- PAT-NO : 5806056 

DOCUMENT- IDENTIFIER: US 5806056 A 
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TITLE: Expert system and method employing hierarchical knowledge base, and 
interactive multimedia/hypermedia applications 

DATE-ISSUED: September 8, 1998 



INVENTOR- INFORMATION : 
NAME 

Hekmatpour; Amir 



CITY 

Burlington 



STATE 
VT 



ZIP CODE 



COUNTRY 



US-CL-CURRENT: 706/50; 706/45, 706/46, 706/61 



Nation Front 



mmwamsmmn 



Date Reference 



□ 6. Document ID: US 5720007 A 

L5: Entry 6 of 9 



File: USPT 



Feb 17, 1998 



US-PAT-NO: 5720007 

DOCUMENT-IDENTIFIER: US 5720007 A 

** See image for Certificate of Correction ** 

TITLE: Expert system and method employing hierarchical knowledge base, and 
interactive multimedia/hypermedia applications 

DATE-ISSUED: February 17, 1998 



INVENTOR-INFORMATION : 
NAME 

Hekmatpour; Amir 



CITY 

Burlington 



STATE ZIP CODE 
VT 



COUNTRY 



US-CL-CURRENT: 706/50; 706/11, 706/46 



Citation Front Review Classification Date Reference 



□ 7. Document ID: US 56 15 112 A 

L5: Entry 7 of 9 File: USPT Mar 25, 1997 

US-PAT-NO: 5615112 

DOCUMENT-IDENTIFIER: US 5615112 A 

TITLE: Synthesized object-oriented entity-relationship (SOOER) model for coupled 
knowledge-base/database of image retrieval expert system (IRES) 

DATE-ISSUED: March 25, 1997 

INVENTOR-INFORMATION: 

NAME CITY STATE ZIP CODE COUNTRY 

Liu Sheng; Olivia R. Tucson AZ 

Wei; Chin-Ping^ -Tucson AZ 
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Ozeki; Takeshi 



Foster City 



AZ 



US-CL-CURRENT: 707 / 104.1 ; 706/11, 706/45, 706/50 



Classification 



□ 8. Document ID: US 5418889 A 

L5: Entry 8 of 9 File: USPT . May 23, 1995 

US-PAT-NO: 5418889 

DOCUMENT-IDENTIFIER: US 5418889 A 

TITLE: System for generating knowledge base in which sets of common causal relation 
knowledge are generated 

DATE-ISSUED: May 23, 1995 

INVENTOR- INFORMATION: 

NAME CITY STATE ZIP CODE COUNTRY 

Ito; Tatsuo Yokohama JP 



US-CL-CURRENT: 7£6/59; 706/45, 706/50 



Classification 



□ 9. Document ID: US 4847784 A 

L5: Entry 9 of 9 File: USPT Jul 11, 1989 

US-PAT-NO: 4847784 

DOCUMENT-IDENTIFIER: US 4847784 A 

** See image for Certificate of Correction ** 

TITLE: Knowledge based tutor 

DATE-ISSUED: July 11, 1989 

INVENTOR- IN FORMAT I ON: 

NAME CITY STATE ZIP CODE COUNTRY 

Clancey; William J. Portola Valley CA 



US-CL-CURRENT: 706/50; 706/46, 706/903, 706/911, 706/916, 706/922 
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Set 
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39 


L9 
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L8 
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212 
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Search Results - Record(s) 1 through 39 of 39 returned. 



□ 1. Document ID: US 20030144884 Al 
Using default format because multiple data bases are involved. 

L9: Entry 1 of 39 File: PGPB 



Jul 31, 2003 



PGPUB- DOCUMENT-NUMBER : 20030144884 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20030144884 Al 

TITLE: Computerized prescription system for gathering and presenting information 
relating to pharmaceuticals 

PUBLICATION-DATE : July 31, 2003 



INVENTOR-INFORMATION: 
NAME 

Mayaud, Christian 



CITY 

New Canaan 



STATE 
CT 



COUNTRY 
US 



RULE-4 7 



US-CL-CURRENT : 7 05/3 



Review Classification 



Sequences Attachments Claims! KVulc 



□ 2. Document ID: US 20030065409 Al 

L9: Entry 2 of 39 File: PGPB Apr 3, 2003 

PGPUB-DOCUMENT-NUMBER: 200300654 09 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20030065409 Al 

TITLE: Adaptively detecting an event of interest 

PUBLICATION-DATE: April 3, 2003 

INVENTOR- INFORMATION: 

NAME CITY STATE COUNTRY RULE-4 7 

Raeth, Peter G. Beavercreek OH US 

Bostick, Randall L. Springboro OH US 

Bertke, Donald Allen Beavercreek OH US 

US-CL-CURRENT: 700/31; 700/28, 700/30, 700/4j4 
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□ 3. Document ID: US 20030058277 Al 

L9: Entry 3 of 39 File: PGPB 



Mar 27, 2003 



PGPUB-DOCUMENT-NUMBER : 20030058277 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20030058277 Al 

TITLE: A VIEW CONFIGURER IN A PRESENTATION SERVICES PATTERNS ENVIROMENT 
PUBLICATION-DATE: March 27, 2003 



INVENTOR-INFORMATION : 
NAME 

B O WMAN - AM UAH , MICHEL K. 



CITY 

COLORADO SPRINGS 



STATE COUNTRY RULE-47 
CO US 



US-CL-CURRENT: 345/765 



Classification 



Sequences Attachments 



□ 4. Document ID: US 20030028651 Al 

L9: Entry 4 of 39 File: PGPB 



Feb 6, 2003 



PGPUB-DOCUMENT-NUMBER: 20030028 651 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20030028651 Al 
TITLE: Proprietary information utility 
PUBLICATION-DATE: February 6, 2003 



INVENTOR-INFORMATION : 
NAME 

Schreckengast , James O . 
Engberg, Anton I. 



CITY 

Fort Collins 
Auburn 



STATE COUNTRY 
CO US 
CA US 



RULE-47 



US-CL-CURRENT: 709/229; 705/52 



Classification 



Sequences Attachments 



□ 5. Document ID: US 20020184178 Al 

L9: Entry 5 of 39 File: PGPB 



Dec 5, 2002 



PGPUB-DOCUMENT-NUMBER : 200201841 78 
PGPUB-FILING-TYPE: new 
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DOCUMENT-IDENTIFIER: US 20020184178 Al 



TITLE: Adaptive knowledge management system for vehicle trend monitoring, health 
management and preventive maintenance 



PUBLICATION-DATE: December 5, 2002 



I N VENTOR- 1 N FORMAT I ON : 
NAME 

Tasooji, Amaneh 
Haigh, Karen Z. 
Reising, Dal Vernon C. 



CITY 
Tempe 

Greenfield 
Coon Rapids 



STATE 
AZ 
MN 
MN 



COUNTRY 

US 

US 

US 



RULE-47 



US-CL-CURRENT: 706/50 



Sequences Attachments 



IB 



n 6. Document ID: US 20020042726 Al 

L9: Entry 6 of 39 File: PGPB Apr 11, 2002 

PGPUB-DOCUMENT-NUMBER: 20020042726 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20020042726 Al 
TITLE: Prescription management system 
PUBLICATION- DATE: April 11, 2002 
I N VENTOR- 1 N FORMAT I ON : 

NAME CITY STATE COUNTRY RULE-47 

Mayaud, Christian New Canaan CT US 

US-CL-CURRENT: 705/2 



Title | Citation | Front | Review [ Classification | Date: | Reference | Sequences | Attachments | Claims) KMC | Of am D 



□ 7. Document ID: US 20020042725 A 1 

L9: Entry 7 of 39 File: PGPB Apr 11, 2002 

PGPUB-DOCUMENT-NUMBER: 20020042725 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20020042725 Al 

TITLE: Computerized prescription system for gathering and presenting information 
relating to pharmaceuticals 

PUBLICATION-DATE: April 11, 2002 

INVENTOR-INFORMATION : 
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NAME 

Mayaud, Christian 



CITY 

New Canaan 



STATE 
CT 



COUNTRY 
US 



RULE- 4 7 



US-CL-CURRENT: 705/2 



Reference 



IJ 8. Document ID: US 20020010679 Al 

L9: Entry 8 of 39 File: PGPB Jan 24, 2002 

PGPUB-DOCUMENT-NUMBER: 2002001067 9 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20020010679 Al 

TITLE: Information record infrastructure, system and method 

PUBLICATION-DATE: January 24, 2002 

INVENTOR-INFORMATION: 

NAME CITY STATE COUNTRY RULE-47 

Felsher, David Paul Trumbull CT US 

US-CL-CURRENT: 705/51; 705/3 



Full | Title | Citation | Front | Review | Classification | Date | Reference Sequences Attachments Claims] KMC \ Dravu D 



□ 9. Document ID: US 20010032029 Al 

L9: Entry 9 of 39 File: PGPB Oct 18, 2001 

PGPUB-DOCUMENT-NUMBER: 20010032029 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20010032029 Al 

TITLE: System and method for infrastructure design 

PUBLICATION-DATE: October 18, 2001 

INVENTOR- IN FORMAT I ON : 

NAME CITY STATE COUNTRY RULE-4 7 

Kauffman, Stuart Santa Fe NM US 

US-CL-CURRENT: 700/99; 700/105, 700/106, 700/97, 705/7 



Full | Title I Citation | Front | Review | Classification | Date | Reference Sequences Attachments Claims] KVulC | Drawn D 



□ 10. Document ID: US 6715145 Bl 
http://westbrs:9000/bin/gate^ 4/21/04 
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L9: Entry 10 of 39 File: USPT 

US-PAT-NO: 6715145 

DOCUMENT-IDENTIFIER: US 6715145 Bl 

TITLE: Processing pipeline in a base services pattern environment 
DATE-ISSUED: March 30, 2004 



Mar 30, 2004 



INVENTOR- INFORMATION : 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE 
CO 



COUNTRY 



US-CL-CURRENT: 718/101; 718/100, 719/316 



Classification 



□ 11. Document ID: US 6640249 Bl 

L9: Entry 11 of 39 File: USPT 

US-PAT-NO: 6640249 

DOCUMENT-IDENTIFIER: US 6640249 Bl 

TITLE: Presentation services patterns in a netcentric environment 
DATE-ISSUED: October 28, 2003 



Oct 28, 2003 



INVENTOR-INFORMATION : 
NAME 

Bowman-Amuah; Michel K. 
US-CL-CURRENT: 709/228; 719/315 



CITY 

Colorado Springs 



STATE ZIP CODE 
CO 



COUNTRY 



Classification Date Reference 



□ 12. Document ID: US 6640244 Bl 

L9: Entry 12 of 39 File: USPT Oct 28, 2003 

US-PAT-NO: 6640244 

DOCUMENT-IDENTIFIER: US 6640244 Bl 

TITLE: Request batcher in a transaction services patterns environment 
DATE-ISSUED: October 28, 2003 
INVENTOR-INFORMATION : 

NAME CITY STATE ZIP CODE COUNTRY 

Bowman-Amuah; Michel K. Colorado Springs CO 
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US-CL-CURRENT: 709/207; 707/10, 718/101 



□ 13. Document ID: US 6640238 Bl 

L9: Entry 13 of 39 
US-PAT-NO: 6640238 

DOCUMENT-IDENTIFIER: US 6640238 Bl 



File: USPT 



Oct 28, 2003 



TITLE: Activity component in a presentation services patterns environment 
DATE-ISSUED: October 28, 2003 



I NVENTOR- 1 N FORMAT I ON : 
NAME 

Bowman-Amuah; Michael K. 



CITY 

Colorado Springs 



STATE ZIP CODE COUNTRY 
CO 



US-CL-CURRENT: 709 /201; 709/20 3 , 709/223, 709/224 



Revieuv Classification 



□ 14. Document ID: US 6636242 B2 

L9: Entry 14 of 39 
US-PAT-NO: 6636242 

DOCUMENT-IDENTIFIER: US 6636242 B2 



File: USPT 



Oct 21, 2003 



TITLE: View configurer in a presentation services patterns environment 
DATE-ISSUED: October 21, 2003 



INVENTOR-INFORMATION: 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE COUNTRY 
CO 



US-CL-CURRENT: 345/764; 345/733, 345/744, 345/762, 345/765 



Classification 



Reference 



□ 15. Document ID: US 6615253 Bl 

L9: Entry 15 of 39 File: USPT Sep 2, 2003 

US-PAT-NO: 6615253 

DOCUMENT-IDENTIFIER: US 6615253 Bl 

** See image for Certificate of Correction ** 
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TITLE: Efficient server side data retrieval for execution of client side 
applications 

DATE-ISSUED: September 2, 2003 



INVENTOR- IN FORMAT I ON : 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE 
CO 



COUNTRY 



US-CL-CURRENT: 709/219; 707/100, 711/118 



IMiBMHtiUFfeaBHaal 



n 16. Document ID: US 6615199 Bl 

L9: Entry 16 of 39 File: USPT Sep 2, 2003 

US-PAT-NO: 6615199 

DOCUMENT-IDENTIFIER: US 6615199 Bl 

** See image for Certificate of Correction ** 

TITLE: Abstraction factory in a base services pattern environment 
DATE-ISSUED: September 2, 2003 
INVENTOR-INFORMATION : 

NAME CITY STATE ZIP CODE COUNTRY 

Bowman-Amuah; Michel K. Colorado Springs CO 



US-CL-CURRENT: 706/50 



Review Classification 



□ 17. Document ID: US 6606660 Bl 

L9: Entry 17 of 39 File: USPT Aug 12, 2003 

US-PAT-NO: 6606660 

DOCUMENT-IDENTIFIER: US 6606660 Bl 

TITLE: Stream-based communication in a communication services patterns environment 

DATE-ISSUED: August 12, 2003 

INVENTOR-INFORMATION: 

NAME CITY STATE ZIP CODE COUNTRY 

Bowman-Amuah; Michel K. Colorado Springs CO 

US-CL-CURRENT: 709/227 
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Classification 



□ 18. Document ID: US 6601234 Bl 

L9: Entry 18 of 39 
US-PAT-NO: 6601234 

DOCUMENT- IDENTIFIER: US 6601234 Bl 



File: USPT 



Jul 29, 2003 



TITLE: Attribute dictionary in a business logic services environment 
DATE-ISSUED: July 29, 2003 



INVENTOR-INFORMATION : 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE COUNTRY 
CO 



US-CL-CURRENT: 717/108; 705/7, 717/107, 717/116 



Classification 



IBjfflEBIIBBagHaMI 



□ 19. Document ID: US 6601 192 Bl 

L9: Entry 19 of 39 File: USPT 

US-PAT-NO: 6601192 

DOCUMENT-IDENTIFIER: US 6601192 Bl 

TITLE: Assertion component in environment services patterns 
DATE-ISSUED: July 29, 2003 



Jul 29, 2003 



INVENTOR- IN FORMAT I ON : 
NAME 

Bowman-Amuah; Michel K. 
US-CL-CURRENT: 714/38 



CITY 

Colorado Springs 



STATE ZIP CODE 
CO 



COUNTRY 



Classification 



□ 20. Document ID: US 6578068 Bl 

L9: Entry 20 of 39 File: USPT Jun 10, 2003 

US-PAT-NO: 6578068 

DOCUMENT-IDENTIFIER: US 6578068 Bl 

TITLE: Load balancer in environment services patterns 



http://westbrs:9000^in/gate.exe?f^TO 4/21/04 
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DATE-ISSUED: June 10, 2003 

INVENTOR- INFORMATION : 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE COUNTRY 
CO 



US-CL-CURRENT: 709/203; 709/226, 718/105 



Full Title Citation Front Re 



Classification Date Reference 



File: USPT 



May 27, 2003 



□ 21. Document ID: US 6571282 Bl 

L9: Entry 21 of 39 
US-PAT-NO: 6571282 

DOCUMENT-IDENTIFIER: US 6571282 Bl 



TITLE: Block-based communication in a communication services patterns environment 
DATE-ISSUED: May 27, 2003 



INVENTOR- INFORMATION : 
NAME 

Bowman-Amuah; Michel K. 



CITY STATE ZIP CODE COUNTRY 

Colorado Springs CO 



US-CL-CURRENT: 709/219; 707/10, 709/203, 719/329 

U3B2ES33II 



Si 



File: USPT 



□ 22. Document ID: US 6550057 Bl 

L9: Entry 22 of 39 
US-PAT-NO: 6550057 

DOCUMENT-IDENTIFIER: US 6550057 Bl 



TITLE: Piecemeal retrieval in an information services patterns environment 
DATE-ISSUED: April 15, 2003 



Apr 15, 2003 



INVENTOR- IN FORMAT I ON : 
NAME 

Bowman-Amuah; Michel K. 



CITY 

Colorado Springs 



STATE ZIP CODE COUNTRY 
CO 



US-CL-CURRENT: 717/126; 700/80, 707/5, 717/101/ 717/102, 717/108/ 1177.101/ 7 17 / 113 



Review I Classification 
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File: USPT 



Apr 15, 2003 



□ 23. Document ID: US 6549949 Bl 

L9: Entry 23 of 39 
US-PAT-NO : 6549949 

DOCUMENT- IDENTIFIER: US 654 994 9 Bl 
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people.cs.uct.ac.za/-hbrown/CAKMS/ - 2k - Cached - Similar pages 

[pdf] Complex Adaptive Knowledge Management 
System 

File Format: PDF/Adobe Acrobat - View as HTML 
Page 1. Intelligent Knowledge System Information 
Visualisation Colin 

Rouse (RSXCOL002) Computer Science Honours Project 
University ... 

people.cs.uct.ac.za/-crouse/ ColinData/ProjectReport.pdf - 
Si milar pages 

[ Mor e re s ults from peop l e. cs .u ct.ac.za ] 

Victim Assistance On Line- JIDV 2003 1 ( 3) 

... Figure 2 Victim Assistance Online's Adaptive Knowledge 

Management System. (Note: 

Arrow size suggests amount of information transfer via indicated 
path). ... 

www.jidv.com/MCCALL t R-JIDV2003-1-(3).htm - 95k - C ache d - 
Simil ar pages 

KAREN HAIGH 

... Adaptive Knowledge Management system for Vehicle Trend 
Monitoring, Health Management 

and Preventative Maintenance. Honeywell patent docket H0001338. 

www-2.cs.cmu.edu/-khaigh/khaigh-cv.html - 43k - Cached - 
Similar pages 



Sponsored Links 

Knowledge Base Software 
Change cost of satisfying customers 
and reduce the burden of inquiries. 
www.rightnow.com/kb3 

Knowledge Mgmt Software 
Web Based, Affordable, Scalable, 
Help Desk Module, Free Trial 
www.novosolutions.com 

Knowledge Mgmt. System 
Build valuable knowledge bases 
in small and medium size companies 
www.powerDOCUMENTS.com 

White Papers on KM 

Knowledge Management White Papers 

and Free Reports on KM technology. 

www.bitpipe.com 

Knowledge Management tool 
Custom software development 
Our knowledge management projects 
www. n o vosoft-u sa . com 

Seeking KM info? 

Visit our KM Knowledge Base 

News, Documents, and Tech Support 

knowledgemanagement.ittoolbox.com 



Evidence Sets: Modellin g Subjective Cate g ories 
... In this section a conversational, collaborative, adaptive, 
knowledge management 

system for databases that uses evidence sets as categorization 
mechanisms is ... 

www.c3.lanl.gov/-rocha/es ijgs.html - 94k - Cached - Similar pages Knowledge Management 

~ ~" Fast and powerful integration of 



Knowledge Management 

Resources and links to KM 
topics. 

www.commerce-database.com 
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File Format: PDF/Adobe Acrobat 

... We find that it represents a very important step in the achievement of a self-adaptive 
knowledge management system, which can discover some changes from the ... 
www.springerlink.com/index/UB8YRYPRJMYWH7LL.pdf - Similar pages 
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Department of Computer Science, University of Cape Town 
2003 Projects in Progress. ... 

www.cs.uct.ac.za/courses/CS400W/projects.html - 18k - Cached - Simila r pages 
About Thinmail 

... He consulted as Chief Scientist to Abuzz, and helped design their adaptive knowledge 
management system. Pollack's work has been reported on in the media. ... 
www.thinm.com/about.htm - 18k - Supplemental Result - Cached - Skni^ 
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ScienceDirect Journals 

Wednesday, April 21, 2004 



STIC's mission is to connect examiners to critical prior art by providing information services and 
access to NPL electronic resources and print collections. A STIC facility is located in each Technology 
Center. 

Most of the electronic resources listed on these Web pages are accessed via the Internet. You must 
be authenticated for data to be accessed. ► MmmM^MiM&m 



Specialized Information Resources for Technology Centers 

Select a Technology Center 

TC2100 |B 



Information Resources and Services 



Breaking News on Emerging Technologies 

List of Major E-Resources 

List of eBook and eJournal Titles 

Reference Tools 

Legal Resources 

Nanotechnolog y 

STIC Online Catalog 

PLUS System 

Foreign Patent Services 

Translation Services 

Trademark Law Library 
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Re quest a Prior Art Search 
Request Delivery of a Book or Article 
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Re quest Forei g n Patent Document 
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ScienceDirect Journals 

Daily Breaking News on Emerging Technologies : 

Encryption 

uspto TI^P* Inform ati on & Data Securit y 

Internet Security 

Wednesday, April 21, 2004 

These resources and services provide examiners with access to critical prior art. Most of the electronic 
resources listed on these Web pages are accessed via the Internet You must be authenticated for 
data to be accessed. > S^m^B^^^^Mi 

indicates tools featured in TC's NPL training. 



Information Resources 



Information Resources bv Class and Subclass 



Databases 

ACM Digital Library 
Business Source Cor por a te 

(Multidisciplinary subject coverage) 
Dialog Classic on the Web 

(Training and password required.) 
DTIC STINET 

(Citations of Defense Technicai Information Center scientific and technical documents) 
EEDD Submission Form 
Examiners' Electronic Di g est Database (EEDD) 

(Database of examiner submitted NPL) 
EPOQUE 

(EPO's databases, available on stand-alone terminal in CPK2, 4B40) 
^ lEEEXplore 

(Full page images of over 800,000 Electrical <& Electronic Engineering articles, papers and 
standards, 1988 -present Select content is available from 1952-1987.) 
INSPEC 

(Seven million well-indexed physics, EE, and IT abstracts, 1969-present) 

IP.com 

(Defensive disclosures published to the Disclosures IP.com database from various websites) 
NTIS (National Technical Information Service) 

(resource for government-funded scientific, technical, engineering, and business related 

information) 
Proguest Direct 

(Multidisciplinary subject coverage) 
Readers' Guide to Periodical Literature 

(citations to popular multidisciplinary magazines) 
Research Disclosure 

(Published, monthly r as a paper journal land [ now as an online database product with advanced full 

text searching capabilities for defensive disclosure information.) 
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Software Patent Institute (SPI) (Select "Free Access") 

(Searchable database of Software Technologies.) 
SPIE Digital Librar y 

(journals and proceedings on optics and photonics) 
STN on the Web (training and password required) 

(The other link is via the Patent Examiner's Toolkit. On your computer, click on the START button, 

then on the PE Toolkit, then on STN Express.) 
True Query 

(A resurrected version of the old "Computer Select" database, providing full text access to over 
100 technology focused publications, a glossary of technical terms, product reviews and over 
60,000 product specifications from 1999 to the present If html code appears on your screen, 
click browser's "Reload" or "Refresh" button.) 



Books and Journals 

c@d Search STIC Online Catalog 
InfoSECURITYnetBASE 
(Information security) 

Knovel 

(Applied science and engineering) 
NetLibrary.com 

(Multidisciplinary subject coverage) 
Safari Online Books 

(Computer and information technology) 
ScienceDirect 

(scientific, technical, and medical journals) 
S pringer Publishin g Company 

(biotech, physics, and computer journals) 

Daily Newspapers 

Fulltext newspaper articles are available electronically in Proquest Direct . 



CD-ROM Resources 

Older full text NPL resources/articles received in CD-Rom format. These resources are 
available on EIC2100 PCs in CPK2, 4B40. 

Equipment 

Reference Tools 

Bartleby.com 

(Several versions ofRoget's Thesaurus, a dictionary, an encyclopedia, quotations, English usage 

books and more.) 
Computer References 

(Dictionaries, Acronyms Finders, Encyclopedias) 
Efunda 

(30,000 pages of engineering fundamentals and calculators) 
Encyclopedia Britannica 
Encyclopedia of Software Engineering 
Eric Weisstein's World of Mathematics 

(A comprehensive online encyclopedia of mathematics.) 
HowStuffWorks 

(Search a term to find articles that explain how it works.) 
Over 2000 Glossary Links 

(Links to numerous technical, specialty, and general glossaries.) 
PCWebopedia 

Wiley Encyclopedia of Electrical and Electronics Engineering 
Yourdictionary.com 
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(Numerous "specialty dictionaries"... technological, law, business related and more.) 

Services 

EIC2100 Staff 

Foreign Patent Services 

PLUS 

Request a Book/Journal Purchase 

Request a Book or Article 

Request a Foreign Patent Publication 

fe-submit ] [Printable form ] 
Request a Prior Art Search 

[e-submit] [Printable form] 

Fast & Focused Search Criteria 
STIC Online Catalog 
Translation Services 



Web Resources 

A Brief History of the Hard Disk Drive 

O Ci te Seer (Rese a r chl ndex) 

(Full text scientific research papers - in pdfand postscript formats.) 
Internet Engineering Task Force 

(The IETF Secretariat, run by The Corporation for National Research Initiatives with funding from 

the US government, maintains an index of Internet-Drafts.) 
Nanotechnology 

Requests for Comments (RFCs) Database 

(Requests for Comments (RFC) document series is a set of technical and organizational 
notes about the Internet (originally the ARPANET), beginning in 1969 and discussing many 
aspects of computer networking, including protocols, procedures and concepts as well as 
meeting notes and opinions.) 

Usenet Archive (Google Grou ps) 

K> Wayback Machine 

(Archived web pages.) 

Submit comments and suggestions to Anne Hendrickson To report technical problems, click here 
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Web Images Group s News Froogle New! more » 
|+"A representation of analogical inference 



Search 



Advanced Search 
Preferences 



"application" (and any subsequent words) was ignored because we limit queries to 
10 words. 

Web Results 1 - 7 of about 20 for +"A representation of analogical inference by fuzzy sets and its applicat 
<i>TalkMine</i> 

... 30 Nakamura, K. and S. Iwai (1982)."A representation of analogical inference by 
fuzzy sets and its application to information retrieval systems." In: Fuzzy ... 

portal.acm.org/ citation.cfm?id=512493&dl=ACM&coll=portal&CFID=1 11111 1 1&CFTOKEN=2222222 - 
&(Di!aEJ?ages 



PUBLICATIONS 

... Kiyohiko Nakamura and Sosuke Iwai "A representation of analogical inference by fuzzy 
sets and its application to information retrieval system," in MM Gupta and ... 
www.brn.dis.titech.ac.jp/-nakamura/papers.html - 15k - Cached - Sim ilar pages 

Biblio g raphy: Methods 

... repres:nakamura1982: K. Nakamura and S. Iwai. A representation of analogical inference 
by fuzzy sets and its application to information retrieval systems. ... 
www.cs.odu.edu/-jbollen/bibliographies/ html/I R_met.html - 7k - Cached - Similar pages 

Original file available from <a href="<a href="<a href="<a href ... 
... INCOLLECTION{repres:nakamura1982 ( author = {K. Nakamura and S. Iwai}, title = {A 
representation of analogical inference by fuzzy sets and its application to ... 
www.cs.odu.edu/-jbollen/bibliographies/ bibtex/IR_met.bib - 12k - Cached - Similar pages 

Relative Uncertainty and Evidence Sets: A Constructivist Framework 
... Nakamura, K., and S. Iwai [1982] "A representation of analogical inference by 
fuzzy sets and its application to information retrieval systems." In: Fuzzy ... 
www.c3.lanl.gov/-rocha/es_contx.html - 61k - Cached - Similar pages 

[pdf] Automatic Conversation Driven by Uncertainty Reduction and ... 

File Format: PDF/Adobe Acrobat - View as HTML 

Page 1. Automatic Conversation Driven by Uncertainty Reduction and 

Combination of Evidence for Recommendation Agents Luis M. Rocha ... 

www.c3.lanl.gov/-rocha/ps/NATO02.pdf - SimilMpages 

[ More results from www.c3 .l an l.gov ] 

[pdf] Biologically Motivated Distributed Designs for Adaptive Knowledge ... 

File Format: PDF/Adobe Acrobat - View as HTML 

Page 1. 1 This sub-section draws from on-going collaboration with Cliff 

Joslyn at the Los Alamos National Laboratory. Many of ideas ... 

arxiv.org/pdf/cs.IR/0002010 - Simi la r pages 
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i^n^Bf NPL Services for Examiners 




USPTO 




ScienceDirect Journals 



Wednesday, April 21, 2004 



STIC's mission is to connect examiners to critical prior art by providing information services and 
access to NPL electronic resources and print collections. A STIC facility is located in each Technology 
Center. 

Most of the electronic resources listed on these Web pages are accessed via the Internet. You must 
be authenticated for data to be accessed. ► kB^MMM^Ms^Mn^ 
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Information Resources and Services 

Breaking News on Emer ging Technolo gies 

List of Major E- Resources 

List of eBook and eJournal Titles 

Reference Tools 

Legal Resources 

Nanotechnolog y 

STIC Online Catalog 

PLUS System 

Forei g n Patent Services 

Translation Services 

Trademark Law Librar y 



Request STIC Services from your Desktop 

Re quest a Prior Art Search 
Re quest Delivery of a Book or Article 
Re quest Purchase of a Book/Journal 
Re quest Forei g n Patent Document 
Req uest a Translation 
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TC2100: EIC Resources and Services 




ScienceDirect Journals 

Daily Breaking News on Emerging Technologies : 
Encryption 

Information & Data Securit y 



Internet Security 

Wednesday, April 21, 2004 

These resources and services provide examiners with access to critical prior art. Most of the electronic 
resources listed on these Web pages are accessed via the Internet. You must be authenticated for 
data to be accessed. > M^mM^imMmm 

indicates tools featured in TC's NPL training. 



Information Resources 



Information Resources bv Class and Subclass 



Databases 

ACM Digital Library 
Business Source Cor porate 

(Multidisciplinary subject coverage) 
Dialo g Classic on the Web 

(Training and password required.) 
DTIC STINET 

(Citations of Defense Technical Information Center scientific and technical documents) 
EEDD Submission Form 
Examiners' Electronic Di g est Database (EEDD ) 

(Database of examiner submitted NPL) 
EPOQUE 

(EPO's databases, available on stand-alone terminal in CPK2, 4B40) 
IEEE Xplore 

(Full page images of over 800,000 Electrical & Electronic Engineering articles, papers and 
standards, 1988 - present Select content is available from 1952-1987.) 
INSPEC 

(Seven million well-indexed physics, EE, and IT abstracts, 1969-present) 

IP.com 

(Defensive disclosures published to the Disclosures IP.com database from various websites) 
NTIS (National Technical Information Service) 

(resource for government-funded scientific, technical, engineering, and business related 

information) 
Proquest Direct 

(Multidisciplinary subject coverage) 
Readers' Guide to Periodical Literature 

(citations to popular multidisciplinary magazines) 
Research Disclosure 

(Published monthly as a paper journal and now as an online database product with advanced full 
text searching capabilities for defensive disclosure information.) 
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Software Patent Institute (SPI ) (Select "Free Access") 

(Searchable database of Software Technologies.) 
SPIE Digital Library 

(journals and proceedings on optics and photonics) 
STN on the Web (training and password required) 

(The other link is via the Patent Examiner's Toolkit On your computer, click on the START button, 

then on the PE Toolkit, then on STN Express.) 
True Query 

(A resurrected version of the old "Computer Select" database, providing full text access to over 
100 technology focused publications, a glossary of technical terms, product reviews and over 
60,000 product specifications from 1999 to the present If html code appears on your screen, 
click browser's "Reload" or "Refresh" button.) 



Books and Journals 

Search STIC Online Catalog 
InfoSECURITYnetBASE 
(Information security) 

Knovel 

(Applied science and engineering) 
NetLibrarv.com 

(Multidisciplinary subject coverage) 
Safari Online Books 

(Computer and information technology) 
ScienceDirect 

(scientific, technical, and medical journals) 
S pringer Publishin g Com pany 

(biotech, physics, and computer journals) 

Daily Newspapers 

Fulltext newspaper articles are available electronically in Proquest Direct . 



CD-ROM Resources 

Older full text NPL resources/articles received in CD-Rom format. These resources are 
available on EIC2100 PCs in CPK2, 4B40. 

Equipment 

Reference Tools 

Bartlebv.com 

(Several versions ofRoget's Thesaurus, a dictionary, an encyclopedia, quotations, English usage 

books and more.) 
Computer References 

(Dictionaries, Acronyms Finders, Encyclopedias) 
Efunda 

(30,000 pages of engineering fundamentals and calculators) 
Encyclopedia Britannica 
Encyclopedia of Software Engineering 
Eric Weisstein's World of Mathematics 

(A comprehensive online encyclopedia of mathematics.) 
HowStuffWorks 

(Search a term to find articles that explain how it works.) 
Over 2000 Glossary Links 

(Links to numerous technical, specialty, and general glossaries.) 
PCWebopedia 

Wiley Encyclopedia of Electrical and Electronics Engineering 
Yourdictionary.com 
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(Numerous "specialty dictionaries"... technological, law, business related and more.) 

Services 

EIC2100 Staff 
Foreign Patent Services 
PLUS 

Request a Book/Journal Purchase 

Request a Book or Article 

Request a Foreign Patent Publication 

[ e-submit ] [ Printable form ] 
Request a Prior Art Search 

[e-submit] [Printable form] 

Fast & Focused Search Criteria 
STIC Online Catalo g 
Translation Services 



Web Resources 

A Brief History of the Hard Disk Drive 

O CiteSe er ( Rese a rc h lndex ) 

(Full text scientific research papers - in pdf and postscript formats.) 
Internet Engineerin g Task Force 

(The IETF Secretariat, run by The Corporation for National Research Initiatives with funding from 

the US government, maintains an index of Internet-Drafts.) 
Nanotechnology 

Requests for Comments (RFCs) Database 

(Requests for Comments (RFC) document series is a set of technical and organizational 
notes about the Internet (originally the ARPANET), beginning in 1969 and discussing many 
aspects of computer networking, including protocols, procedures and concepts as well as 
meeting notes and opinions.) 

«&* Usenet Archive (Google Groups) 

Wayback Machine 

(Archived web pages.) 

Submit comments and suggestions to Anne Hendrickson To report technical problems, click here 
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and their practical use. Human interaction with integrated automation in man-machine systems is 
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Presently we are living in times of rapid socio-technical changes with certain dangers of possible 
instabilities. These changes refer, on the one hand, to 

- progress in science and technology, particularly in information and communication 
technologies, and, on the other, to 

- inequalities in the standard of living, for example, with respect to food supply, housing, 
health care, and mobility, as well as in individual and social freedom, 

- environmental and social consequences of thoughtless technological developments, 

- the need for conversion of many military and very high-risk technologies, and 

- the need for trust, responsibility, tolerance, and mutual support in individual, social, and 
international relations. 

One may come to the conclusion that during the last two to three decades, many problems on our globe 
have worsened. Certainly, parts of the world have attained higher standards of living, more individual 
and social freedom, and higher mobility than ever experienced before. However, larger parts of the 
world are far from reaching these standards and have even suffered deteriorations in several cases. Thus, 
the poor and the developing countries are sometimes lagging further behind, and they see much larger 
gaps between themselves and the highly developed countries than a few decades ago. 

What about the industrialized countries themselves? There, technological developments have also 
brought about a large number of negative long-term effects. Environmental problems due to the 
consumption of energy and materials, traffic, and waste (radioactive, toxic, and non-toxic) have created 
many concerns with respect to the future qualities of air, water, and soil. Other technological 
developments have led to social consequences such as unemployment, unreasonable distribution of 
work, and isolation. Traffic congestion in cities and on highways as well as fatal accidents with cars, 
aircraft, power plants, and industrial processes may remind us of our limited capabilities and 
understanding. Some experts have recently estimated that the delayed consequences of the reactor 
catastrophe of the Chernobyl nuclear power plant in 1986 will amount to between one and two million 
casualities over the next years. Additional risks have only started to become visible to the general 
public, since the end of the Cold War between the West and East blocs of the industrialized countries 
makes most of the industrial-military complex obsolete on both sides. The need for conversion of 
institutions, systems, and materials has been recognized as a huge challenge. 

It seems that the amount of clearing work to be done in the near future will be overwhelming. To distrust 
science and technology because of their negative side-effects will certainly not be an appropriate 
solution. Instead, science and technology are badly needed to perform the clearing work in an 
appropriate way and also for improving the standard of living - substantially in poor and developing 
countries, but also moderately in developed countries. Often, several degrees of development exist 
within a single country. Therefore, suitable strategies are required that try to avoid earlier errors, when 
further developing technologies and societies. In order to accomplish this enormous task for mankind in 
the near future of the next two to three decades, we need a spirit of trust, responsibility, tolerance, and 
mutual sup port in individual, social, and international relations. And we all need to share in the extra 
work to be done as well as in the financial and socio-psychological burdens. I believe that information, 
communication, and truthfulness together with the adoption of a realistic long-term balance of costs and 
benefits will contribute to building up this spirit and the willingness to share as a prerequisite for 
peaceful developments. 

Information and communication technologies will therefore play an important role for humane 
development all over the world. However, the very many possible misuses of these technologies need to 
be banned internationally as much as does the violation of human rights. Each individual human being 
must have the possibility of access to any information he or she wishes to receive and to understand. 
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Because of the many individual limits to understanding different kinds of information, special tools have 
to be available for navigating through the information. 

In this paper, I will restrict myself to a special kind of tool for computer-aided information transfer and 
self-learning. Through a further restriction, the paper mainly concentrates on simulated man-machine 
systems that are to be used as information tools. They are dynamic and interactive and, thus, can 
demonstrate and teach how technical systems - the machines - are to be operated and maintained. 
Combined with regularly renewed licensing of human task responsibilities, such tools may possibly help 
to avoid at least some of the most fateful accidents. Before discussing these tools in more detail in 
section 3, the most prominent technical and cognitive aspects of man-machine systems will be 
introduced in section 2. The paper concludes in section 4 by pointing out the need for further work on 
realizing the suggested tools that now exist at best only in laboratory versions. 

2, Human interaction with integrated automation in man-machine systems 

2.1 Control and Problem-solving Tasks 

All dynamic technical systems that are operated by one or several human beings can be viewed together 
with these human operators as man-machine systems. Thus, all kinds of vehicles, continuous and 
discrete industrial processes, power plants, robots and manipulators, business and public information 
systems, biomedical support systems, and many more are man-machine systems in this sense. To 
achieve the prescribed goals of safe and efficient operation of man-machine systems, two main 
categories of tasks, controlling and problem solving, have to be performed. In principle, both task 
categories can be performed by the human operator(s) as well as by automatic computerized systems. 

The control activities comprise reaching, open-loop and closed-loop control in the narrower sense of 
control theory, monitoring, and lower supervisory control functions such as intervening in automated 
processes. On higher cognitive levels, problem-solving activities have to be performed. These include 
fault management, particularly with fault diagnosis and correction, goal setting and hypothesis 
generation, planning, and the higher supervisory control functions such as teaching. The distinction 
between control and problem-solving tasks is especially advocated by Johannsen [11,12]. The latter is a 
task-oriented concept, whereas the overlay of the supervisory control paradigm is an interaction-oriented 
concept. The latter consists of a hierarchical, decentralized structure with task-interactive computers at 
the lower level and human-interactive computer(s) at the coordinating, higher level [26]. The five 
generic supervisory control functions are planning, teaching, monitoring, intervening, and learning. 



Different levels and phases of human and automatic controlling and problem solving (after ref. 13) 
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Human and automatic controlling and problem solving show several similarities, but there are also 
differences between both forms of the two task categories. A further classification of these task 
categories is illustrated in the table. The table shows human and automatic activities separated into three 
succeeding Information-processing phases, namely categorization, planning, and action (see also Rouse 
[21] and Sundstrom [30]). These information-processing phases can be cycled through on three distinct 
behavioural levels, namely the state-oriented, the context-oriented, and the structure-oriented levels, 
which correspond in some way to the cognitive levels of behaviour as suggested by Rasmussen [18, 19]. 

The main domains of automation systems are the complete state-oriented level as well as at least some 
parts of the categorization phase of the context-and structure-oriented levels. Of course, human 
operators can also be engaged in these activities. However, they are particularly superior to automation 
systems in the planning and action phases of the context-and structure-oriented levels. These areas of 
table 1 correspond more to the problem-solving tasks and, thus, require higher cognitive behaviour. This 
is even true when prescribed plans, so-called scripts, have to be selected and rules for actions have to be 
applied on the basis of observed symptoms. The human operator is particularly indispensable when new 
plans have to be generated and rules have to be applied on a topographic or completely structural 
relationship because an unforeseen situation has to be dealt with. 

The recent aircraft accident near Stockholm is a good example of the latter case, although it also has 
elements of the context-oriented level. After the engines no longer worked as the aircraft neared the 
ground, the pilots had only a very short time to plan and execute an emergency landing on a field just 
behind a forest. All passengers survived because of the excellent human performance. Where to glide 
down with the aircraft had to be decided on the structure-oriented level, whereas many of the 
subordinated guidance and control activities were probably done with some kind of script selection. 
These scripts were built up during previous simulator training. It is a general policy that pilots are well 
trained by means of simulated critical events in order to build up more automated scripted behaviour that 
can be reproduced much faster than the generation of new plans but will hopefully never be needed in 
reality. 

The higher cognitive functions as described with table 1 can also, at least partially, be handled with new 
information technologies. There are knowledge-based decision support systems. Similarly, like human 
operators, these decision support systems mainly process symbolic information about contexts and 
structures rather than numerical information about signals and states. Thus, it is necessary to realize 
some kind of signal-to-symbol transformations and vice versa to be performed by the human operator or 
the computerized system when freely navigating through the whole plane of table 1 . 

Appropriate function and task allocations determine which tasks will best be performed by the human 
operators and which will best be assigned to the computerized systems. With an integration between 
traditional automation systems and the more recent information technologies of the decision-support 
systems, human-centred designs and dynamic forms of task allocations are possible (see, e. g., Rouse 
(22]). 

2.2 Integration between Traditional Automation and Decision-Support Systems 

Human-centred designs of integrated automation will lead to improved man-machine systems in the 
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very near future. These perspectives occurred because of knowledge-based information technologies. 
The term integrated automation means that traditional automation systems and knowledge-based 
decision-support systems cooperate closely in a suitable way. The criteria for what is suitable, however, 
need to be defined and require the human-centred approach that is also part of the integrated automation 
concept. 

As elaborated in more detail by Johannsen [1 1], an extended Operator (User) Interface Management 
System architecture for dynamic technical systems allows the description of the integrated automation 
concept with a number of separated levels (see also Alty and Johannsen [2]). Figure 1 shows these levels 
of the UIMS architecture. The features of man-machine interfaces will be reviewed in the next 
subsection. Here I discuss the different levels of the technical system as shown in figure 1 . The 
information selector 1 processes numerical information, whereas the information selector 2 transforms 
signals into symbols for the information processing at the decision-support level. This level cooperates 
with the traditional automation of the supervision and control level. 

Decision-support systems can be subdivided into those that are more application oriented and those that 
are more human operator oriented. In figure 1, they are called application model support and operator 
model support, respectively. The application model support systems deal with situations in the technical 
process and the supervision and control system. The information that is processed for these situations is 
then communicated to the human operator as a decision support. Operators will normally perform a 
dialogue with such decision-support systems in order to satisfy their information needs. These 
application model support systems can also be viewed with respect to the behavioural levels as 
suggested in table 1 . Examples for these three levels are the decision support for heuristic control [17], 
for fault diagnosis (e.g., Borndorff-Eccarius [3]), and for plant management; see Johannsen [1 1] for 
more details. 

Similarly, the operator model support systems deal more directly with human operators' behaviour and 
help them to perform as well as possible. Again, three behavioural levels can be distinguished. 
Examples are human error evaluation (e.g., Hessler [9]), plan or intent recognition (e.g., Rubin et al. 
[24]), and procedural support (e.g., Sundstrom [30]); more details are given in Johannsen [11]. 

A mathematical framework for interaction between traditional automation and decision-support systems 
is supplied by Johannsen [1 1] and explained with four case-studies. This mathematical framework 
requires much more precision and details that can only become available after a lot of further 
multidisciplinary research. 

2.3 Man-Machine interfaces with Graphical and Dialogue Support 

The presentation level and the dialogue level describe the two distinct aspects of any man-machine 
interface, as shown in figure 1 . The presentation level concerns the form of the information and, thus, 
includes the displays and controls, which are more and more often computer graphics screens and 
computerized control input systems, as well as some knowledge-based graphics support modules. The 
dialogue system is a kind of central intermediary between the human operator(s) and all levels of the 
whole technical system, including the decision-support systems, and deals with the contents of 
information flows in the man-machine communication. Loose ends of dialogue can occur, particularly in 
critical situations, when an urgent request of a subsystem of the technical system interrupts the 
interaction of another one with the human operator [2]. Handling these loose ends of dialogue can be 
supported by small-scale knowledge-based dialogue assistants for the interaction with the different 
subsystems of the technical system. 
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Figure 1 Extended Operator (User) Interface Management System structure for dynamic 
technical systems (after Johannsen, 1992) 
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The visual display units with colour graphics screens allow flexible and task-adapted forms of 
presentation. Many options for picture design exist, but the multitude of alternatives can also be misused 
if the designers lack enough knowledge about ergonomics and the information needs of human operators 
[10]. Dynamical shifts of information needs in the problem space of the two dimensions of the degree of 
detail and of the level of abstraction must be taken into account even more with advanced information 
display concepts, as already suggested by Goodstein [8]. The design of graphics support can lead to 
knowledge-based graphical systems that dynamically generate new picture contents by using knowledge 
of the application, of the operator model based on information search needs, of graphical presentation 
techniques, and of dialogue techniques. Such concepts require an integration of computer graphics and 
knowledge-based technologies [5, 6]. A similar approach for knowledge-based designer support and 
intelligent man-machine interfaces for process control was suggested by Tendjaoui, Kolski, and Millot 
[32]. The cognitive engineering approach must also be applied here to answer the question of how to 
present information to the human operator(s) and to design appropriate graphical decision support for 
the goal-directed, spatial visualization of task-meaningful units and their relations [34]. The searcher for 
which interaction media to use has, among others, to consider recent results on multimedia research [1]. 

Advanced man-machine interfaces that integrate knowledge-based task and operator models as decision- 
support systems with presentation and dialogue submodules were particularly investigated by Tendjaoui, 
Kolski, and Millot [32] and by Sundstrom [30], and reviewed by Johannsen [1 1], Application and 
process knowledge as well as ergonomic knowledge and knowledge about the information search needs 
of the human operator(s) in different operational situations determine which information needs to be 
displayed, when, and how. In principle, cooperative interactions between several human operators and 
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the knowledge-based decision-support systems are possible. However, the state of the technology has 
not yet advanced to the level of rigorous industrial applications. 

2.4 Transformation and Use of Knowledge by Knowledge Engineers, Designers, and Operators 

Human operators do not use only their own knowledge in interactions within man-machine systems. In 
addition, a lot of knowledge is available to them directly or indirectly through the information 
acquisition system, the supervision and control system, and the decision-support systems. Much of this 
knowledge has been supplied by the designers of these systems. The maintenance personnel find 
themselves in a similar situation; however, the decision-support systems, as well as the man-machine 
interfaces designed for them, may be different from those for the human operators. This is indicated in 
the lower part of figure 2. The figure also shows that in addition, a tutoring system may have been 
designed to teach novices how to operate or to maintain the whole technical system. 

Figure 2 Stages of knowledge transfer and Euan-machine interaction for knowledge engineers, 
designers, operators, and maintenance personnel 
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The designer creates knowledge support implemented in the different subsystems for the human 
operators and the maintenance personnel. Similarly, the designers themselves can be assisted by 
appropriate decision-support systems or, in the case of novices, by a tutoring system. This too is shown 
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in figure 2, as well as the fact that the man-machine interface for the designer is normally completely 
different from those for the operator and the maintenance personnel. As mentioned above, the designers 1 
decision-support systems may include an application model with knowledge and data about the technical 
process and its supervision and control system; an operator model will be provided with knowledge 
about the information search needs of the human operator as well as ergonomic and design procedural 
knowledge. The problem-solving strategies are mainly left with the designers because they determine 
the creative part of any design. 

As is clear from figure 2, the knowledge contained in the designers' decision-support systems also needs 
to be generated. This is done in the knowledge acquisition process by the knowledge engineer and/or the 
domain experts who supply their technological and operational know-how for the conceptualization and 
implementation of the decision-support systems. Thus, the whole process of knowledge and information 
transfer as shown in figure 2 starts with the know-how of some experts and is carried through successive 
stages with their respective interactions by knowledge engineers, designers, and operators or 
maintenance personnel. Human errors that are made at any of the earlier stages may be propagated to 
later stages and, finally, may adversely influence the operation of the man-machine system. Reason [20] 
pointed out, for example, that the human errors of designers can sometimes be compensated for by the 
human operators but may also be the main contributing factor to turning a certain critical situation into a 
catastrophe. Regulations with product liability are more and more concerned with these aspects. Errors 
in early stages may eventually have severe consequences that call for careful avoidance and correction 
strategies as well as for training towards responsibility. 

3. Knowledge-based information access by means of simulation and self-learning tools 

3.1 Training Supervision and Control Tasks with Simulated Man-Machine Systems 

Simulators of cars, trucks, aircraft, ships, power plants, chemical plants, and other technical processes 
are valuable tools for research and development as well as for training. They have a long tradition in 
aeronautics and astronautics, but nowadays are more often used in other application domains. The 
appropriate simulation fidelity is an important technical, psychological, and economic issue. Often, part- 
task simulators are sufficient, particularly for research. The simulation fidelity needs to be higher when 
professionals are to be trained in how to deal with difficult task situations. On the other hand, cheap 
simulators would be sufficient for less difficult tasks such as driving a car. A new technology for such 
inexpensive simulators for regular refresher training of drivers is needed, in my opinion, as one 
countermeasure to the far too many traffic accidents. 

Simulated man-machine systems will be a technology that goes beyond the use of simulators. Here, the 
human operator's behaviour in supervision and control tasks is also simulated. This requires fairly 
accurate human performance models as well as models of mental workload. As Stassen et al. [29] 
summarized, such models are available for lower cognitive levels of human behaviour such as those 
required in manual control, failure detection, and monitoring. The use of these models in closed loops 
with the technical system leads to completely simulated man-machine systems. They can demonstrate in 
real time to any one interested how good or bad human interaction with a specific technical system may 
be. For training purposes, play-back capabilities for repeating any situation of interest, human 
interaction facilities with the possibility of comparing the trainee's with the ideal or bad simulated 
behaviour and performance, and explanations in separate text and graphics windows are necessary. 
Particularly with explanation facilities, such a simulated man-machine system becomes a tutoring 
system or self-learning tool for the training of supervision and control tasks for specific technical 
systems. 

The three cognitive levels of human behaviour suggested by Rasmussen [19], namely skill-based, rule- 
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based, and knowledge-based behaviour, also have to be addressed appropriately during any training 
process. As Sheridan [25] proposed, computer aiding has to supply different support and needs different 
forms of interaction at these three levels. Demonstrations seem to be appropriate at the lowest level, 
whereas rules and advice are called for respectively at the two higher levels. A simple example may 
illustrate this. We assume a simulated man-machine system for training in car-driving tasks and select a 
typical driving situation on a motorway. This situation may be characterized by driving into and through 
a construction zone with narrower lane width and dense oncoming traffic. The demonstrations may 
show the outside view in real time for different selected speeds and may exemplify certain critical 
situations or even accidents. Rules for explaining the reasons behind the speed limits and the 
behavioural choices in critical situations may be shown in a separate window on the computer screen. 
This needs to be visible when observing the simulated outside view on the same colour graphics screen 
but shall not impair the main driving task. The explanations may be further supported by additional 
demonstrations. Only after the online demonstrations are terminated is the knowledge-based advice 
given. The human operator can take as much time as needed to interrogate the computer support in an 
interactive dialogue fashion. In this way, knowledge-based behaviour can be trained and, thus, through 
training, becomes rule-based behaviour. 

Time pressure in the latter training phase and, generally, on the knowledge-based behavioural level is 
dangerous because it can even lead the human operator to fall back on the skill-based behavioural level 
with, then, a high risk of human errors [4]. The very last phase of the Chernobyl nuclear power plant 
accident can be explained by the choice under dramatic time pressure of the wrong skill-based behaviour 
instead of the necessary knowledge-based behaviour [16]. It may even be possible to demonstrate such 
human errors online in the simulation by freezing certain situations and by giving additional 
explanations for the wrong behaviour and for the causes behind it. 

3.2 Self-learning Tools for Problem-solving Tasks 

Not only supervision and control tasks but also the higher cognitive problem-solving tasks need to be 
trained appropriately. Unfortunately, our research results, particularly with respect to modelling 
problem-solving tasks, are not as well developed as our knowledge about control tasks [15]. It is even 
arguable whether it will ever be possible to model higher cognitive human functioning. Human 
creativity is a major ingredient in these functions and is mainly responsible for keeping the human being 
in the man-machine system. Planning tasks have not as yet been modelled sufficiently. Some models 
exist for human fault diagnosis tasks [23]. The more important research results contribute evaluations 
and concepts for experimental fault-diagnosis situations. Also, knowledge-based decision-support 
systems as computer aids for fault diagnosis were developed, as mentioned above (see also Johannsen 
and Alty [14]; Tzafestas [33]). 

The idea here is to use and to integrate concepts, experimental results, models, and computer support 
systems for developing tools that allow self-learning and the information transfer of problem-solving 
tasks. The combination of such tools with the on-line simulation tools, as described in the preceding 
subsection, may further enhance the quality of the training system. It must be possible for human beings 
anywhere in the world to sit by themselves in a silent place in order to learn or just to understand 
basically how a particular technical system can be managed and operated, and how problems with this 
system can be solved once they occur. A reasonably large personal computer should be sufficient for 
such self-learning and information transfer purposes. Only the recent hardware revolution makes it 
feasible to supply enough computer power for such new training endeavours, even in geographically 
very remote places and in fairly limited economic situations. In the latter cases, access to the computer 
tools has to be organized for sharing their use in a way similar to that of using public library facilities. 

Two off-line advisory systems for training maintenance personnel in fault-diagnosis capabilities will be 
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described here as existing examples for self-learning tools in problem-solving tasks. These two systems 
are FAULT (Framework for Aiding the Understanding of Logical Trouble-shooting), developed by 
Rouse and Hunt [23] and their colleagues over several years, and ADVISOR (Advanced Video 
Instructor), developed by Tanaka and others [31]. 

The original idea of FAULT was to investigate whether generalizable capabilities for fault diagnosis 
exist in human beings. Therefore, an early experiment was designed with the very abstract task of 
diagnosing a single fault in a complex network of nodes. In a second, more realistic example, the faulty 
components had to be identified in an electrical network with AND and OR gates. The connections 
between the components also included feedbacks. Both examples are suitable for training human 
operators in fairly general, context-free skills. With the FAULT system, a series of further experiments 
was performed that were context-specific, as in real-life tasks. The chosen networks were now 
schematics of car, aircraft, and ship engines with their main subsystems and components. The human 
subjects started the fault diagnosis with rather general symptoms (e.g. the engine will not start). Then 
they had to check gauges, ask for information about specific components, make observations, or remove 
components for testing. The symptom, the status of all available gauges, and the selected actions with 
their costs were displayed in different windows on the computer screen. Several forms of computer 
aiding based on models of human problem solving were used to assist the maintenance personnel in 
their troubleshooting tasks. The results of the experiments showed that human problem solving, which 
depends on how well the human operators understand the problems, is not optimal; see Rouse and Hunt 
[23]. There seems to be a trend towards context-dominated problem-solving behaviour. This is, 
however, not completely context-specific, as can be seen from human beings' abilities to make 
transitions into unfamiliar problems and to cope with ill-defined and ambiguous situations. 

The recognized human cognitive limitations in problem-solving tasks can be overcome by computer- 
aiding systems based on some problem-solving performance models. Simpler computer aids may just be 
structure-oriented bookkeeping tools. In FAULT, it was shown that the bookkeeping methods 
consistently improved human performance, even after later transfer to unaided problem solving. FAULT 
was also used as a self-learning tool for maintenance personnel of ship engines. Like a tutor, the tool 
guided the human subjects through different knowledge-acquisition stages and problem-solving phases. 
Nowadays, similar tools are used for individual self-learning and for quick prescribed testing of the 
required status of knowledge at freely selected assessment times in airlines. These tools supplement the 
use of aircraft simulators in pilot training. 

The ADVISOR system is another learning environment for maintenance [31]. It was developed jointly 
by the Tokyo Electric Power Corporation and Mitsubishi Electric Corporation. An interface-centred 
design approach was chosen, whereby multimedia techniques were also used. The system has some 
pedagogical interfaces to enhance the understanding of novices and to help them manage troubles and 
make appropriate guesses. Useful information and suggestions are provided in a format best adapted to 
the current understanding of the human subject, although the system does not provide a perfect model of 
human problem-solving performance. A prototype was developed for the maintenance of gas insulated 
switch gears in the power industries. 

ADVISOR is implemented on a workstation, a personal computer, a videodisc, and a TV display. A real 
TV picture of the interesting views on and into the equipment in the maintenance situation is shown on 
the TV display with superimposed text windows for explanations and touch-sensitive virtual keys for 
interrogations. On the neighbouring colour graphics display of the workstation, learning from examples 
can be supported by explaining what the cause-consequence structures for a number of alarms look like 
in a multiple fault situation. Thus, the novice can learn the principles behind the examples. Also, the 
pedagogical interfaces can be shown with several windows on the display of the workstation as supports 
for recognizing the current status in the whole learning space as well as the significance of each step and 
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the intention behind it in the maintenance sequence. It is not known to this author whether the evaluation 
of the ADVISOR system was terminated, and what kind of results were achieved. 

3.3 Self-learning Tools for Understanding Man-Machine Systems Engineering 

Any man-machine system is a part or subset of a larger system with broader boundaries in the systems 
engineering sense. This has already been shown in figure 2 with the relationships between knowledge 
engineering, designing, operation, and maintenance; several man-machine systems are involved in this 
case. Nowadays, even broader contexts and perspectives need to be understood by different human 
agents dealing with man-machine systems; these include political decision makers, managers, designers, 
or operators. Different levels of understanding in different contexts are required. For example, 
environmental and economic issues, matters of legislation and liability, dependencies within a logistics 
network and of market developments, and many more technical and non-technical influences are to be 
considered in a real-life systems engineering approach towards decision support, design, and operation 
(see figure 3). 

If knowledge about the needs and the functions of safe systems operation and careful problem solving in 
man-machine systems is better understood all over the world, then people will probably be more 
concerned about the selection and the proper use of many technical systems in their societies. The 
current challenges of technology transfer into developing countries and of conversion with risky systems 
in the industrialized countries, as mentioned already in the introductory section of this paper, may be 
better and more rapidly understood; possibly more competent opinions might be expressed if self- 
learning and information transfer tools were already available. Certainly a particularly strong need for 
such tools exists among high-level decision makers and public opinion moderators, namely among 
politicians, leaders of big and medium-sized companies and banks, and journalists (see figure 3). Their 
knowledge is often too limited and their time to learn something new very restricted, but they 
nevertheless have to make decisions quickly and as correctly as possible or to comment on actual events 
almost immediately. The suggested computerized tools for self-learning and information transfer will 
certainly complement libraries and more traditional information retrieval systems. 

In a way similar to that in the prototypes mentioned in the preceding sub section, namely FAULT and 
ADVISOR, self-learning tools for understanding the broader issues of human interaction with technical 
systems in a societal context have to draw on a combination of decision-support systems, appropriate 
multimedia presentation and dialogue techniques in advanced man-machine interfaces, and explanation 
and justification facilities. The design approach for such tools has to start from requirements and 
cognitive task analyses that lead to the different decision-support functions needed for different types of 
later users of the tools. The explanation and justification facilities as well as the advanced man-machine 
interfaces have to be adapted to different information transfer and learning needs that are to be satisfied 
by the different decision-support systems. 

Figure 3 Understanding man-machine systems engineering 
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3.4 Cultural Aspects of Using Simulation and Self-learning Tools 

Simulation and self-learning tools, as mentioned in subsections 3.1 through 3.3, have to be used in free 
societies by different kinds of people with different kinds of education, different cognitive abilities for 
understanding systems, functions and context, and different kinds of responsibilities. Thus, one may say 
that different cultural patterns for approaching problems and interacting with socio-technical systems 
exist even within one particular society. Sometimes the differences between two distinct views of the 
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same system are cultivated unnecessarily, as often occurs with the distinction Snow [28] showed 
between the two cultures of science, namely one for the human and the social sciences and one for the 
natural and the engineering sciences. Bridging the gaps between all kinds of possible views seems to be 
more and more important for understanding our world and for contributing to a peaceful future. 

These gaps between cultures can be much larger when we look at the differences between societies that 
developed quite independently from each other over many centuries. Take the Japanese and the German 
cultures as examples that show a completely distinct dimension of cultural differences from those within 
either of these two societies. Sheridan et al. [27] dealt with many facets of these cultural apects. 

Although the gaps between different cultures, individual as well as societal, became much smaller 
through the influence of many technologies, particularly the information technologies, many unique 
traditions and language barriers remain. They have to be accepted and even preserved with patience, 
goodwill, and historical sense. However, they need also to be overcome mentally in order to allow 
worldwide cooperation as well as exchange of ideas and products in a successful and mutually 
rewarding manner. The ideas and technologies of one culture have to be appropriately adapted to 
another culture when a high degree of user acceptability shall be reached. This requires sensitive 
tutoring for systems designers in the delivering culture as well as concerned training for end-users in the 
receiving culture. Thus, two types of simulation and self-learning tools may well be suitable. For the 
designers, one type can aid the understanding of other cultures. For training purposes, the other type can 
support understanding of the culturally adapted technology. Multilingual explanation facilities seem to 
be important aids where appropriate and where necessary to enhancing understanding for the tools that 
have to consider cultural differences. The use of voice output and input within a multimedia 
environment may even allow illiterates to get acquainted with new technical systems by means of the 
suggested tools. 

The need for investigating and for considering cultural aspects in the design and use of technologies, in 
particular automation and information technologies, have only recently been recognized, also by at least 
some engineers and computer scientists. In the International Federation of Automatic Control (IFAC), a 
Working Group on Cultural Aspects of Automation was formed in 1990, for example. They organized 
their first workshop in October 1991 [7]. 
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4. Needs for future research and socio-technical development 

The overall objectives mentioned in the introduction of this paper for using computer-aided information 
transfer and self-learning tools can only be achieved with further research combined with particular 
socio-technical developments. Future research is needed in the areas of human performance modelling 
and problem solving, goal and knowledge structures, cognitive limitations, knowledge acquisition, and 
all their contributions to the design of more cooperative interactive decision-support systems. More 
research is required in the development of knowledge-based explanation and justification facilities as 
well as in advanced man-machine interfaces with multimedia presentation and dialogue techniques. 
Information retrieval and tutoring techniques also have to be farther developed for the particular needs 
of these tools. 

In addition to the future research requirements just mentioned, the socio-technical development of 
simulated man-machine systems and self-learning tools has to be fostered for many application domains. 
An integrated multidisciplinary approach towards development and training for expanding information 
access seems to be mandatory. Several specialized companies as well as research and development 
centres with an existing or planned international operational basis have to take up the new challenges of 
information dissemination in a more systematic way. Then we can hope that a sufficient number of 
people all over the world will appropriately understand human interactions with all kinds of technical 
systems in order to contribute through responsible decisions to the future and peace of mankind. 

Of course, the most elementary needs of food, shelter, and health have to be satisfied first. This has yet 
to be accomplished for more than 40 per cent of the world population, due in particular to the lack of 
environmental conservation according to a very recent report of the World Health Organization. Only 
after an acceptable minimum standard of living is reached will people be concerned with seeking better 
information supply. However, even for solving these elementary problems, a lot of information support 
is required, for example in order to enforce environmental conservation. Thus, we face a vicious circle. 
To get out of this is also very much a matter of politics, economics, and world trade. But nothing can be 
accomplished without more proper use of science and technology. 
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William B. Rouse 
Abstract 

The design of information systems is considered in terms of the viability, acceptability, and validity of 
the information support provided. These issues are discussed in the context of several examples, 
including systems for bibliographic information retrieval, aircraft operations, maintenance information, 
sales transaction support, and design information. A variety of "lessons learned" that illustrate the 
impact of adopting a human-centred approach to designing information systems is summarized. 

L Introduction 

Information is an essential ingredient in much that we do. We spend much time gathering, refining, and 
interpreting information. This process of digesting information has become increasingly complex as the 
store of information has become larger and more diverse. 

The size of the information store makes it difficult to consume all relevant information. The increasing 
diversity of information sources, forms, and languages makes it difficult to identify and interpret all 
relevant information. Often indigestion and sometimes "information poisoning" result. 

Information technology appears to provide the means whereby these problems can be overcome. 
Hypermedia, multimedia, natural language processing, expert systems, and CD-ROM are notable 
examples. Numerous commentators over the past 40 years projected that technologies such as these 
would soon help us to deal with the information explosion. Each of these commentators has, at best, 
. been a bit too optimistic. 

One could argue that the proclamations of success were premature because the cost and/or power of 
computer technology, as well as related technologies, did not evolve as quickly as anticipated. While 
this may be true, I believe that more subtle problems have hindered progress. Put simply, enabling 
technologies such as those noted above may be necessary, but they are not sufficient for success. 

To support this assertion, consider the following two examples. In the late 1970s and early 1980s, we 
undertook an effort to put hard-copy procedural information on-line. It seemed intuitively obvious that 
problems associated with the growing size and number of technical manuals could be lessened, or 
perhaps eliminated by moving to computer-based information systems. 

Two studies were performed in the context of aircraft operations manuals [5,6]. Of particular interest 
here is the first study, where one condition involved putting on the computer display the exact same 
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information, in the same format, as in the hard-copy manuals. Experimental results for this condition 
indicated the computer-based system was substantially inferior to the hard-copy presentation. 

The problems appeared to be due to the inherently limited screen size and the distinct possibility of 
getting lost in the display hierarchy. Fortunately, means were devised for alleviating these problems and 
a derivative of the display system discussed by Rouse, Rouse, and Hammer [6] is being used in the 
Boeing 777 aircraft. Nevertheless, the "lesson learned" is clear- simply putting information on a 
computer does not necessarily make it more useful than presenting it in more traditional ways. 

The second example concerns an effort in the mid-1980s to develop intelligent bibliographic 
information retrieval systems, primarily for use by engineers and scientists. Five studies were performed 
to understand how various computer aiding schemes affected users' abilities to retrieve information of 
value. The results of this series of studies are reviewed by Morehead and Rouse [3]. 

Three of the studies considered the impact of providing links among articles based on reference lists. As 
we expected, such links helped considerably. This led us to add further links based on citations of 
articles. In this way, an article was linked to both its ancestors and its descendants. 

Much to our surprise, the citation links substantially degraded users 1 performance. Users tended to 
wander down citation paths long after they ceased to be productive. We modified the system to display 
the productivity metric of articles selected divided by articles viewed. In this way, the decrease in 
productivity of citation paths became evident to users and they abandoned citation paths much sooner. 
The "lesson learned" here is also clear - providing more links among information elements is not 
necessarily beneficial and may be detrimental. 

Thus, the intuitively obvious benefits of enabling information technologies are not always realized. The 
straightforward reason is that intuition is not always right, as numerous lottery customers will attest. 
Rather than betting on technologies, users would be much better served if we first focused on the 
benefits sought, and then considered alternative means of providing these benefits. 

2. Human-centred design 

The types of problems noted earlier can be avoided, and the potential of enabling information 
technologies can be realized, by adopting a human-centred approach to designing information systems. 
Human-centred design is a process of assuring that the concerns, values, and perceptions of all 
stakeholders in a design effort are considered and balanced [X]. 

Stakeholders include users, customers, maintainers, investors, and so on. Further, the designers of 
information systems are stakeholders in these systems. While this paper necessarily focuses on users, 
were we to discuss the design, development, implementation, and servicing of an actual information 
system, we would consider all of the stakeholders. 

Human-centred design can be viewed as a process for addressing and resolving the seven issues listed in 
figure 1. Four of these issues (i.e., evaluation, demonstration, verification, and testing) are well known 
to designers of information systems and are usually addressed in a reasonable manner. These four issues 
are not discussed within the confines of this paper. Interested readers will find a comprehensive 
treatment of these issues in Rouse [8]. 

The top three issues in the figure (i.e., viability, acceptability, and validity) are seldom addressed with 
sufficient rigour by designers of information systems. Human-centred design involves pursuing all of 
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the issues in figure 1, starting at the top. Thus, the first question asked is "What matters?" while the last 
question asked is "Does it run?" 

Rouse [8] discusses a four-phase methodology, as well as associated methods and tools, for pursuing the 
seven issues in figure 1 . In this paper, discussion focuses on elaborating the nature of viability, 
acceptability, and validity. The use of these constructs is subsequently illustrated in the context of a few 
applications. 

Viability is concerned with benefits and costs. Contrary to the apparent beliefs of many designers of 
information systems, the primary benefits to users seldom include having the opportunity to use an 
information system. Users typically use an information system to make better-informed decisions, solve 
problems, order products and services, save time, and so on. 

Costs may include access charges; however, such costs are often paid by third parties. For most users, 
costs include the difficulty and time involved in learning to use and in using the system, as well as the 
difficulty and time associated with using the outputs of the system. Thus, for example, one of the costs 
of using conventional computer-based information retrieval systems is the difficulty and time of wading 
through the hundreds or thousands of abstracts obtained, as well as locating and obtaining source 
documents. 

Viability(p) Are the Benefits of System Use Sufficiently Greater than its Costs? 

Acceptability(p) Do Organizations/Individuals Use the System? 

Validity (p) Does the System Solve the Problem? 

Evaluation (p) Does the System Meet Requirements? 

Demonstration (p) How Do Observers React to System? 

Verification (p) Is the System Put Together as Planned? 

Testing (p) Does the System Run, Compute, Etc.? 

Figure 1 Human-centred design issues 

Acceptability concerns the extent to which a way of doing things fits in with individual and 
organizational preferences and constraints. For instance, the hardware and software of an information 
system should be compatible with other hardware and software employed by users and their 
organizations. A more subtle need is for usage procedures for the information system to be compatible 
with usage procedures for other systems used by the same set of users. An example of preference-related 
acceptability concerns would-be users' desires for colourgraphic displays despite the fact that 
monochromatic alphanumeric displays would be less expensive and provide a valid means to meeting 
information needs. 

Validity focuses on whether or not an information system solves the users 1 information-seeking 
problems. It is quite possible for a system to meet requirements - that is, pass evaluation with flying 
colours - but not provide valid support. For example, an information system might rapidly retrieve and 
display masses of information, much of which is irrelevant, the remainder of which is only marginally 
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understandable by the class of users for which the system was designed. While one could blame this on 
the quality of the databases and argue that the information system satisfies its technical requirements, it 
is nevertheless a fact that the system does not provide a valid solution to users' problems. One might 
attempt to resolve this problem by adding artificially intelligent functionality that reads and translates all 
of the information retrieved to assure that what users get is relevant and understandable. This would not 
necessarily lessen validity problems if users were skeptical of the computer's ability to perform such 
filtering and translation. 

Note that the discussions of human-centred design in this section have only paid passing attention to 
display formats? dialogue structures, and so on. While these issues are important, they are nor 
synonymous with the user-system interface within the human-centred design framework. Within this 
framework, the interface is "deeper" than the displays and keyboard. The interface includes all 
functionality whose goals are to enhance human abilities, overcome human limitations, and foster user 
acceptance [8]. 

Therefore, within human-centred design, one does not design an information system and then "add" a 
user-system interface. Instead, one begins with the user in terms of benefits, costs, etc., and 
progressively deepens the design. At some point, one translates the means to providing benefits into 
particular enabling technologies. Typically, the design of displays and input devices naturally evolves in 
this progression. In this way, human-centred design not only results in systems that are usable- it also 
produces systems that are useful. 

3. Applications 

In this section, three example applications are discussed: (1) maintenance information systems; (2) sales 
transaction systems; and (3) design information systems. The purpose of these illustrations is to show 
how human-centred design influences the nature of the products and systems that result. 

3.1 Maintenance Information Systems 

The application concerned the problem of transforming large, blueprint-size hard copy, often called C 
size, to small, computer-display-size images [2]. The context of interest was helicopter maintenance. 

A very important element of human-centred design is initial emphasis on defining the true nature of the 
problem to be solved. From the point of view of the humans involved in this context, the problem of 
interest was helicopter maintenance, not reading blueprints. Thus, in terms of validity the primary 
concern was providing information to support maintenance activities rather than finding a way to access 
blueprints on a small display. 

This realization led us to focus on the tasks to be done rather than on the nature of blueprints. It became 
clear that information is used in different ways depending on the nature of the task, i.e., problem solving 
vs. procedure execution. This conclusion led us to adopt Rasmussen's abstraction-aggregation hierarchy 
[4] as a means of organizing maintenance information. 

The abstraction dimension included physical form, physical function, and generalized function depicted 
in terms of location diagrams, schematics, and block diagrams, respectively. The aggregation dimension 
included assembly, subsystem, and system-level representations. As a consequence of this approach to 
organizing information, it was no longer necessary to have large displays. 



This system concept was evaluated in a series of five experiments. It was determined that the nature of 
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the displays affected maintainers' activities. They performed at least as well using the new displays and 
overwhelmingly preferred the new displays. Further, it was determined that creation and updating of the 
display database would be easier with the new approach. Thus, both acceptability and viability were 
improved. 

3.2 Sales Transaction Support 

Computer-mediated sales are an increasingly prevalent approach to selling in retail stores, banks, 
airlines, and many other domains. Perhaps not surprisingly, there has been considerable interest in 
improving the user-system interface of such systems. Of particular concern, because of the high turnover 
among people performing such jobs, has been decreasing or possibly eliminating the need for any 
extensive training in the use of these systems. 

We undertook two efforts in this area, one in the domain of retail sales and the other in passenger 
reservation systems. In both cases, we were asked to improve the usability of these systems by focusing 
on the user-system interface. We employed the human-centred design methodology to pursue these 
efforts. 

In both cases, we focused initially on viability, acceptability, and validity for a period of 4-6 weeks. We 
discovered that usability problems, while important, were by no means the predominant concern. The 
benefit sought in both cases was increased sales and the cost was the time required to make sales. 

It would have been quite possible to solve usability problems without enhancing viability - increasing 
benefits and/or decreasing costs. Focusing solely on usability would have probably increased individual 
user acceptance but not necessarily organizational acceptance. Finally, solving usability problems alone 
might have met requirements, but would not have been a valid solution to the right problem. 

For both efforts, the initial focus on viability, acceptability, and validity led to an emphasis on sales 
support rather than solely on improved operability of computer terminals. While usability and the user- 
system interface still received much attention, it was given in the context of supporting the tasks that 
really mattered. The result was system designs that were substantially different from those originally 
envisioned. 

3.3 Design Information Systems 

The application under design information systems focused on access to and utilization of science and 
technology information in the context of designing aerospace systems. The motivation for this effort 
included a long-term interest in the value of information [7, 1 1], as well as a practical need to develop 
design information systems. 

In keeping with the human-centred approach to design, we began by focusing on viability, acceptability, 
and validity. These issues were pursued using questionnaires, interviews, and observational techniques 
involving a large number of designers [9]. We found that very little science and technology information 
is accessed by formal means. 

Why don't designers take advantage of science and technology information? One answer is that they 
perceive little benefit and great cost in accessing this type of information. They attach no benefit to 
using the information system per se. 

They are concerned with making informed design decisions. They become informed by asking other 



http://www.unu.edu/unupress/unupbooks/uu07ee/uu07ee0k.htm 



4/21/04 



4. Needs for future research and socio-technical development 



Page 9 of 14 



people in their organization, a conclusion also reached by Allen [1], Why do they rely on subjective 
opinions rather than the "hard" objective information provided by science and technology? A primary 
reason is that they find published research results to be applicable in general but not to their specific 
problems in particular. They want contextually based answers to their questions rather than generic 
simplifications. In other words, they question the validity of available science and technology 
information. 

There are also acceptability problems. Almost all science and technology information is created, written, 
and published for consumption by scientists and technologists. Designers seldom have the specialized 
expertise, or the patience, to penetrate this information. They find the context and format of presentation 
totally unacceptable. 

The essense of the designer's dilemma is depicted in figure 2. Each transformation in this diagram 
requires time and effort. Both time and effort increase as one moves to the right in this diagram. It is 
easy to see why a designer would not want 1,000 abstracts of research articles on human memory to 
answer a question concerning usability of radar modes. The cost of answering questions in this way far 
outweighs the benefits. 

The above conclusions concerning designers* perceptions of viability, acceptability, and validity caused 
us to focus on designers' tasks and information needs rather than on the nature of science and technology 
information. Thus, rather than focusing on how to get designers to access and utilize science and 
technology information, we looked at the information requirements to support design decision-making. 
Such requirements should drive the way in which science and technology information is created, 
organized, formatted, and accessed if this information is intended to support design. 

Figure 2 Alternative transformations in answering questions 
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After considering alternative representations, we concluded that information seeking in design could be 
represented as a process of asking questions and pursuing answers in the context of a "design space" 
including a set of archetypical tasks focused on attributes of the design artifact and characterized in 
terms of abstraction and aggregation [10]. Typical scenarios or trajectories in the design space were 
studied to determine information requirements in particular and support requirements in general. Using a 
structured analysis and design methodology [8] led to identification of hundreds of requirements and an 
appropriate conceptual architecture that would satisfy these requirements. 

4. Lessons learned 

The human-centred design issues of viability, acceptability, and validity have been discussed in the 
context of several examples, including systems for bibliographic information retrieval, aircraft 
operations, maintenance information, sales transaction support, and design information. In this section, 
the lessons learned from these efforts are summarized. 

First and foremost, it is essential to recognize that information access and utilization are seldom ends in 
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themselves. The benefit sought is successful task performance, not information seeking. Thus, primary 
tasks of interest do not include operating an information system. 

Regarding primary tasks, the information requirements associated with these tasks would dictate 
information system design. The existing organization and format of information should not, to the extent 
possible, constrain the nature of an information system. It should also be noted that the ways in which 
information requirements are satisfied are likely to vary with tasks, despite the fact that the same 
information content may be required for two or more tasks. 

Simply putting information on a computer display is not necessarily better, and may be worse, than 
using other media, unless appropriate aiding is provided to enable using the information in new ways. 
Similarly, additional information is not necessarily better, and may be worse, without appropriate aiding 
to enable using the new information. 

People tend to interpret the validity of information in a very context-specific manner relative to their 
needs at the moment. People are also more likely to find information acceptable if its format and content 
make it easy to understand and interpret. 

Finally, by focusing on the issues of viability, acceptability, and validity within the human-centred 
design framework, one is much more likely to solve the right problem and solve it in an acceptable way. 
The result is information systems that are both usable and useful. 

5. Conclusions 

The information explosion continues unabated. The promise of information technology has long been 
heralded as a means of containing, and perhaps counteracting, this explosion. This paper has argued and 
illustrated with many examples that the problem is not amenable to technology panaceas. Instead, 
success is much more likely if the concepts, principles, methods, and tools of human-centred design are 
used to determine contextually relevant information requirements, as well as synthesize support systems 
that satisfy these requirements. 
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Abstract 

Hypertext and hypermedia are introduced as a solution to the question of how best to produce and 
provide the information now required by all kinds of users. The new generation of information systems 
must be user-oriented and task-driven, and their design should rely on knowledge about the manner in 
which the human mind processes information. Extensive reference is made to the cooperative 
hypermedia authoring environment SEPIA. 

Introduction 

I start from the assumption that the world of today - and, certainly, that of tomorrow - depends more and 
more on the availability of the right information at the right time and in an appropriate quantity and 
quality. Not judging in this context whether this development is good or bad, a question remains on how 
to produce this information and how to provide it to clients, students, teachers, engineers, readers, and 

users in general. My first claim is that hypermedia systems will offer a solution to this problem. They 

represent the beginning of the development of a new generation of information and publication systems. 
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It is my second claim that the development of these information systems has to follow the approach of 
user-oriented and task-driven system design. It is my third claim that the application of this approach has 
to rely heavily on knowledge about human information processing, i.e. cognitive theories. In summary, I 
claim the inherent capabilities of hypermedia systems will meet the requirements of cognitively 
adequate human-computer interfaces and the demands for task-driven provision of functionality needed 
to support a variety of work activities. 

The goal of this contribution is to show for selected areas what is needed in order to live up to the 
expectations raised by the concept of hypertext and hypermedia. The paper is structured as follows: 
First, I introduce the concepts of hypertext and hypermedia. Second, I present five basic requirements 
for user-oriented and task-driven system design. Third, I describe the proposed research and 
development strategy in the context of the cooperative hypermedia authoring environment SEPIA. 
SEPIA is an example of how the design of an interactive system is heavily based on theories of human 
information processing, in this case on cognitive models of authoring hyperdocuments. SEPIA is part of 
the current research activities at the Integrated Publication and Information Systems Institute (IPSI) of 
the Gesellschaft fur Mathematik und Datenverarbeitung (GMD) in Darmstadt, Germany. 

L Hypermedia systems 

1.1 Basic Concepts 

First, we need to distinguish between hypertext and hypermedia. In my usage, hypertext uses the 
structural aspects. This concept is based on the idea of a nonlinear organization of pieces of information 
("nodes") that can be referenced and related to each other by "links" in an associative manner and 
constitute a network structure (directed graph including cycles). An essential feature of hypertext is the 
capability of having machine-supported links within and between documents. On the other hand, I use 
the term hypermedia if the nodes contain multimedia contents, e.g. sound, complex graphics, pictures, 
video, or animation. No doubt multimedia aspects will contribute to the attractiveness and dissemination 
of the innovative hypertext concept. But one has to note that multimedia provides only the technological 
basis, e.g. digitizing pictures and compressing them, showing video in a window, editing sound, etc. 
Currently, multimedia applications consist more or less of the presentation of a collection of multimedia 
content. What is lacking is structure, a concept of how to relate information elements to each other, how 
to use this information, which again has implications for the combination and presentation of 
information. But this is what hypermedia is all about. 

I claim that hypermedia systems will provide qualitatively new means for producing, communicating, 
and comprehending knowledge and will radically change the conditions of the information society [26, 
27]. Additional information will be provided as we go along. Since the expectations about the potential 
of hypermedia systems are very high, the role of hypermedia in a comprehensive information 
environment has to be clarified. In my opinion, expectations will not be met by relying solely on the 
concept of hypertext and hypermedia. Rather, these are the crystallization nucleus for the development 
of a new generation. They must be complemented by considering and integrating existing results and 
future achievements in the following areas: 

- ergonomic design of human-computer interaction database management systems 

- information retrieval 

- knowledge-based components 

- publication and high-quality layout systems 

- telecommunication and computer networks 
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Current hypermedia systems are only a first demonstration of the elementary principles that raise our 
interest in what is still to come in the future. Since there is no space to discuss the deficits of existing 
systems and approaches, I refer to Conklin [4], Halasz [6, 7], Russell [2]], and Streitz [26, 27]. Much of 
the confusion about hypermedia is caused by people's attempts to define it as one application among 
others, as similar, e.g., to desktop publishing. From my perspective, hypermedia systems are 
technological examples of a set of basic but very powerful principles with a high potential for 
innovations that enable the definition and creation of new applications or value adding for existing 
applications. 

1 .2 Authoring versus Retrieval 

Discussions about the implications of computer technology for the information society seem to address 
primarily problems of how to provide information (presentation, retrieval, filtering, etc.). While these 
are valid issues, at least an equally important aspect is largely neglected: a prerequisite for information 
retrieval and presentation - not only in hypermedia systems - is that this information must have been 
produced. Therefore, we have to provide tools for authoring and production. The quality of the next 
generation of hypermedia systems will depend on the extent and quality of support in authoring 
environments. Most of the hyperdocuments currently produced rely on the method of "turning (existing 
linear) text into hypertext." There may be value in turning existing paper or linear electronic documents 
into electronic hyperdocuments. But the results rarely show what an innovative hyperdocument could 
actually be like. Most of the existing tools for creating hypertexts are not well suited for this task. A 
review of existing guides shows that the issue of providing adequate conceptual support for authors of 
hyperdocuments has not been sufficiently addressed. There is another deficit in hypertext research with 
respect to writing. Current research is not really addressing the crucial problem that producing a non- 
linear document might require very different concepts of creating, revising, and composing documents 
and therefore different kinds of support. But it is my strong belief that the concepts of hypertext and 
hypermedia will only be convincing and successful if there are dedicated tools that correspond to the 
special characteristics inherent to the innovative potential of hyperdocuments. 
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W. Geib, Stephen V. Metz, Rose Mae R. Richardson, Stephen D. Whitlow, John A. Allen, Lawrence A. King, 
John Phelps, Victor A. Riley and Peggy Wu. A method for monitoring, recognizing, supporting and responding 
to the behaviour of an actor. Patent docket number H0003359, provisional disclosure filed March 2002. 

3. Karen Zita Haigh and Kevin Matthew Kramer, A Method and Apparatus for Determining a Measure of 
Similarity Between Natural Language Sentences. Patent Docket 1 1 00. 1 1 25 1 0 1 . Application filed 29 June 200 1 . 

4. Ioannis Pavlidis, Vassilios Morellas, Steve Harp, and Karen Haigh. Moving Object Assessment System and 
-Method. Honeywell patent docket-number H0002442. Provisional disclosure filed June 29, 2001 (U.S. patent 

pending 60/302,020), full application filed December 27, 2001). 
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5. Amaneh Tasooji, Karen Haigh and Dal Vernon Reising. Adaptive Knowledge Management system for Vehicle 
Trend Monitoring, Health Management and Preventative Maintenance. Honeywell patent docket H0001338. 
Application filed 4 June 2001, U.S. patent pending 09/874,074. 

Publications (Theses, Journals, Magazines) 

1. Lisa Meeden, Alan Schultz, Tucker Balch, Rahul Bhargava, Karen Zita Haigh, Marc BGhlen, Cathryne Stein, 
David Miller, "The AAA I 1999 Robot Events," AI Magazine, 21(3):69-77, Fall 2000. 

2. Karen Zita Haigh and Tucker Balch, "AAAI-98 Robot Exhibition," AI Magazine, 2 1 (1 ):67-76, Spring 2000. 

3. Karen Zita Haigh and Manuela M. Veloso, " Learning Situation-Dependent Costs: Improving Planning from 
Probabilistic Robot Execution ," Robotics and Autonomous Systems, 29: 145-174, 1999. Invited. 

4. Karen Zita Haigh, " Situation-Dependent Learning for Interleaved Planning and Robot Execution ." Ph.D. 
Thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213-3891, February 1998. 

5. Karen Zita Haigh and Manuela M. Veloso, " Interleaving Planning and Robot Execution for Asynchronous 
User Requests ," Autonomous Robots, 5(l):79-95, March 1998. Invited. 

6. Karen Zita Haigh, Jonathan Richard Shewchuk and Manuela M. Veloso, " Exploiting Domain Geometry in 
Analogical Route Planning ." Journal of Experimental and Theoretical Artificial Intelligence. 9(1997):509-541. 

7. Reid G. Simmons, Richard Goodwin, Karen Zita Haigh, Sven Koenig, Joseph O'Sullivan, Manuela M. Veloso. 
" Xavier: E x perience with a Layered Robot Architecture ." ACMSigart Bulletin. 8(l-4):22-33, 1997. 

8. Stan Matwin, Tom Szapiro and Karen Haigh, "Genetic Algorithms Approach to a Negotiation Support 
System," IEEE Transactions onSystems, Man and Cybernetics, 21(1): 102-1 14, 1991. 

Publications (Refereed Conferences) 

1. Valerie Guralnik and Karen Zita Haigh. "Learning Models of Human Behaviour with Sequential Patterns." 
Submitted to Proceedings of the Nineteenth National Conference on Artificial Intelligence (AAAI), July 2002. 

2. Karen Zita Haigh, John Phelps and Christopher W. Geib. "An Open Agent Architecture for Assisting Elder 
Independence." To appear in Proceedings of the First International Joint Conference on Autonomous Agents 
and MultiAgent Systems (AAMAS), July 2002. 

3. Reid Simmons, David Apfelbaum, Dieter Fox, Robert P. Goldman, Karen Zita Haigh, David J. Musliner, 
Michael Pelican, and Sebastian Thrun. " Coordinated Deployment of Multiple, Heterogeneous Robots ". In 
Proceedings of the Conference on Intelligent Robots and Systems (IROS), Takamatsu, Japan, October 2000. 

4. Karen Zita Haigh and Manuela M. Veloso, " Planning. Execution and Learning in a Robotic Agent ." in R. 
Simmons, M. Veloso and S. Smith, Proceedings of Artificial Intelligence Planning Systems (AIPS 98), June 
1998, Pittsburgh, PA. Pages 120-127. 

5. Karen Zita Haigh and Manuela M. Veloso, " Learning Situation-Dependent Costs: Improving Planning from 
Probabilistic Robot Execution, " in K. Sycara, Proceedings of the Second International Conference on 
Autonomous Agents, May 1998, Minneapolis, MN. Pages 231-238. 

6. Karen Zita Haigh and Manuela M. Veloso, " High-Level Planning and Low-Level Execution: Towards a 
Complete Robotic Agent ." in W. L. Johnson, Proceedings of the First International Conference on Autonomous 
Agents, February 1997, Marina del Rey, CA. Pages 363-370. 

7. Reid Simmons, Richard Goodwin, Karen Zita Haigh, Sven Koenig, Joseph O'Sullivan. " A Layered 
Architecture for Office Delivery Robots ." in W. L. Johnson, Proceedings of the First International Conference 
on Autonomous Agents, February 1997, Marina del Rey, CA. Pages 245-252. 

8. Karen Zita Haigh and Manuela Veloso, " Interleavin g Planning and Robot Execution for Asynchronous User 
Req uests, " in the Proceedings of the International Conference on Intelligent Robots and Systems (IROS), 
November 1996. Osaka, Japan. Pages 148-155. 

9. Karen Zita Haigh and Manuela Veloso, " Route Planning bv Analog y." in M. Veloso and A. Aamodt, Case- 
Based Reasoning Research and Development, First International Conference (ICCBR-95), October 1995, 
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Sisembra, Portugal. Pages 169-180. 



Publications (Reffeireed Workshops) 

1. Karen Zita Haigh, David J. Musliner, Sunondo Ghosh, " RT-MLab: Really Real-Time Robotics ". In 
Proceedings of Workshop on Life Cycle Software Engineering Technology for Modern Avionics, Missiles, and 
Smart Weapon Systems, August 2000, Huntsville, AL. 

2. Robert P. Goldman, Karen Zita Haigh, David J. Musliner, and Michael Pelican, " MACBeth: A Multi-Agent 
Constraint-Based Planner ." In Proceedings of the AAAl workshop ^Constraints and AI Planning', July 2000, 
Austin, TX. Pages 11-17. 

3. Karen Zita Haigh, David J. Musliner, and Sunondo Ghosh, " RT-MLab: Really Real-Time Robotics ". In 
Proceedings of the AAAl Spring Symposium "Real-Time Autonomous Systems", March 2000, Stanford, CA. 
Pages 24-31. 

4. Karen Zita Haigh and Manuela M. Veloso, "Learning Situation-Dependent Rules: Im proving Task Planning 
for an Incompletely Modelled Domain " In Proceedings of the AAAl Spring Symposium ^Search Techniques for 
Problem Solving under Uncertainty and Incomplete Information ', March 1999, Stanford, CA. Pages 30-35. 

5. Karen Zita Haigh and Manuela M. Veloso, " Learning Situation-Dependent Costs: Using Execution to Refine 
Planning Models, " In Proceedings of the Ninth International Workshop on the Principles of Diagnosis (DX98), 
May 1998, Cape Cod, MA. Pages 55-62. 

6. Karen Zita Haigh and Manuela M. Veloso, " Planning with Multiple Goals for Robot Execution ". In 
Proceedings of the AAAl Fall Symposium "Plan Execution: Problems and Issues", November 1996, Boston, 
MA. Pages 61-71. 

7. Karen Zita Haigh and Manuela Veloso, " Using Perception Information for Robot Planning and Execution ", in 
the Proceedings of the AAAI-96 Workshop "Intelligent Adaptive Agents", August 1996, Portland, Oregon. 
Pages 23-32. 

8. Karen Zita Haigh and Manuela Veloso, " Interleaving Planning and Robot Execution for Asynchronous User 
Requests ", in the Proceedings of the AAAI-96 Spring symposium "Planning with Incomplete Information for 
Robot Problems", March 1996, Stanford, California. Pages 148-155. 

9. Karen Zita Haigh and Jonathan Richard Shewchuk and Manuela M. Veloso, " Route Planning and Learnin g 
from Execution ". In Working notes from the AAAl Fall Symposium "Planning and Learning: On to Real 
Applications", November 1994, New Orleans, LA. Pages 58-64. 

10. Karen Zita Haigh and Jonathan Richard Shewchuk, " Geometric Similarity Metrics for Case-Based Reasoning ". 
In Case-Based Reasoning: Working Notes from the AAAI-94 Workshop, August 1994, Seattle, WA. Pages 182- 
187. 

1 1 . Karen Haigh and Manuela Veloso, " Combining Search and Analogical Reasoning in Path Planning from Road 
Ma ps ". In Case-Based Reasoning: Papers from the 1993 Workshop, July 1993, Washington, D.C. Pages 79-85. 



Publications (Unrefereed) 

1. Joseph O'Sullivan, Karen Zita Haigh and G. D. Armstrong. " Xavier - the Manual vQ.3 "'. Learning Robot 
Laboratory Internal Document. April 1997. 

2. Reid Simmons, Sebastian Thrun, Greg Armstrong, Richard Goodwin, Karen Haigh, Sven Koenig, Shyjan 
Mahamud, Daniel Nikovski and Joseph O'Sullivan, "Amelia", in the Proceedings of the Thirteenth National 
Conference on Artificial Intelligence (AAAI-96), August 1996. Portland, Oregon. Page 1358. 

3. S. Matwin and T. Szapiro and K. Haigh, "Genetic Algorithms Approach to a Negotiation Support System " 
Technical Report TR-89-30, Computer Science Department, University of Ottawa, Ottawa, Ontario, Canada. 



Awards 

2001: 

1992-1998: 
1994-1996: 
1992-1996: 



Honeywell Technical Achievement Award 
Graduate Fellowship, Carnegie Mellon University. 
Postgraduate Scholarship, Canadian Space Agency. 

Postgraduate Scholarship, Natural Sciences and Engineering Research Council of 



http://2 1 6.239.5 1 . 1 04/search?q==cache:PRTnI 1 dlFAgJ: ww-2.cs.cmu.edu/^khaigh/khaigh-cv.. . 4/2 1/04 



KAREN HAIGH 



Page 5 of 5 



Canada. 



Professional Activities 

2002: Chair, AAAI-02 workshop 'Automation as Caregiver: The Role of Intelligent Technology in Elder 

Care' 

2000-current: Senior Member of the Society of Women Engineers (SWE) 
1996-current: Member of AAAI (American Association of Artificial Intelligence) 
200 1 : Greenbelt Certification 

2000-200 1 : Member of the AAAI membership committee 

2001 : Paper reviewing: Agents 2001, IEEE conference on Multi-agent systems, Second workshop on 

Infrastructure for Agents, MAS, and Scalable MAS, Special session on Learning and Adapting in 
AI Planning at the International Conference on AI 

2000: Paper reviewing: IEEE Trans, on Knowledge and Data Engineering, IEEE Control Systems 

Magazine, Agents 2000, AAAI 2000 

1999: Paper reviewing: AAAI 99, AAAI 99-student abstracts 

1999: Co-chair of the Robot Exhibition, AAAI 99 

1998: Co-chair of the Robot Exhibition, AAAI 98 

1995-1998: Maintainer of Dinner Co-op WWW site, http://dinnercoop.cs.cmu.edu/dinnercoop/ 



Activities Outside Computer Science 



Cooking: 

Travel: 

Pottery: 
Photography 



Outdoor: 
Other: 



Organized and cooked for the Dinner Co-op, a co-operative cooking group of about 15 people in 
Pittsburgh. 

Sixteen months in China, total two+ years in Europe, six months in New Zealand, five years in 

Kenya (as a child), and numerous short visits to other countries. 
Had two pieces displayed at the Carnegie Museum of Art, Pittsburgh. June 1997, January 1998. 
Travel photography; also yearbook photographer in high school and special events photographer, 

International Students Association, University of Ottawa. 
Cycling, Canoeing, Camping, Hiking, Swimming, Cross Country Skiing. 
Learning languages, Book collecting, Piano, Quilting, Sewing, Winemaking, Orchid growing. 



Personal 

Languages: Native English. Good French and Mandarin Chinese. 
Citizenship: Canada, United Kingdom. 
Visa status: U.S. permanent resident. 
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Abstract: Zadeh's Fuzzy Sets are extended with the Dempster-Shafer Theory of Evidence 
into a new mathematical structure called Evidence Sets, which can capture more efficiently 
all recognized forms of uncertainty in a formalism that explicitly models the subjective 
context dependencies of linguistic categories. A belief-based theory of Approximate 
Reasoning is proposed for these structures. Evidence sets are then used in the development 
of a relational database architecture useful for the data mining of information stored in 
several networked databases. This useful data mining application establishes an Artificial 
Intelligence model of Cognitive Categorization with a hybrid architecture that possesses 
both connectionist and symbolic attributes. 

INDEX TERMS: Fuzzy Sets, Dempster-Shafer Theory of Evidence, Interval Valued Fuzzy 
Sets, Uncertainty, Cognitive Categorization, Constructivism, Relational Databases, 
Distributed Memory, Information Technology; Information Retrieval; Adaptive 
Collaborative Systems; Knowledge Management. 



to Cognitive Categorization 

Categories are bundles of concepts somehow associated in some context. Cognitive agents 
survive in a particular environment by categorizing their perceptions, feelings, thoughts, 
and language. The evolutionary value of categorization skills is related to the ability 
cognitive agents have to discriminate and group relevant events in their environments 
which may demand reactions necessary for their survival. If organisms can map a 
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potentially infinite number of events in their environments to a relatively small number of 
categories of events demanding a particular reaction, and if this mapping allows them to 
respond effectively to relevant aspects of their environment, then only a finite amount of 
memory is necessary for an organism to respond to a potentially infinitely complex 
environment. 

Thus, knowledge is equated with the survival of organisms capable of using memories of 
categorization processes to choose suitable actions in different environmental contexts. It is 
not the purpose here to dwell into the interesting issues of evolutionary epistemology 
[Campbell, 19745 Lorenz, 1971] , I merely want to start this discussion by positioning 
categorization as a very important aspect of the survival of memory empowered organisms. 
Understanding categorization as an evolutionary (control) relationship between a memory 
empowered organism and its environment, implies the understanding of knowledge not as a 
completely observer independent mapping of real world categories into an organism's 
memory, but rather as the organism's, embodied, thus subjective, own construction of 
relevant - to its survival - distinctions in its environment. These ideas have been developed 
in more detail in [Rocha, 1997a, 1997^; Henry and Rocha, 1996] where an epistemological 
position named Evolutionary Constructivism is outlined and defended. 

Since effective categorization of a potentially infinitely complex environment allows an 
organism to survive with limited amounts of memory, we can also see a connection between 
uncertainty and categorization. Klir [1991] has argued that the utilization of uncertainty is 
an important tool to tackle complexity. If the embodiment of an organism allows it to 
recognize (construct) relevant events in its environment, but if all the recognizable events 
are still too complex to grasp by a limited memory system, the establishment of one-to- 
many relations between tokens of these events and the events themselves, might be 
advantageous for its survival. In other words, the introduction of uncertainty may be a 
necessity for systems with a limited amount of memory, in order to maintain relevant 
information about their environments. Thus, it is considered important for models of 
human categories to capture all recognized forms of uncertainty. In the following, I address 
the historical relation between set theory and our understanding of categories; in particular, 
I discuss what kind of extensions we need to impose on fuzzy sets so that they may become 
better tools in the modeling of subjective, uncertain, cognitive categories. 

2o Models of Cognitive Categorization 

It is important to separate the idea of a model of cognitive categorization and a model of a 
category. Though obviously dependent on one another, categories are included in more 
general models of cognitive categorization and knowledge representation. Agreeing on what 
the structure of a category might be, is far from agreeing on what the structure and workings 
of cognitive categorization models should be. It is also a simpler problem. Though, 
undoubtedly, the specific model of knowledge organization selected will dictate some of the 
properties of categories, the particular structure chosen to represent categories in such 
models does not have to offer an explanation for knowledge organization. All that is asked of 
a good category representation, is that it may allow the larger imbedding model of 
knowledge representation to function. For instance, if we use sets to represent categories, 
our models of knowledge representation may use set theory connectives and/or they may 
use more complicated sets of mappings or even introduce connectionist machines to 
produce the sets [Clark, 1993]. Thus, evaluating sets as prospective representations of 
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categories should be done by analyzing the kinds of limitations they necessarily impose on 
any kind of model, and not simply models circumscribed to basic set-theoretic operations. 

2.1 The Classical View 

The classical theory of categorization defines categories as containers of elements with 
common properties. Naturally, the classic, crisp, set structure was ideal to represent such 
containers: an element of a universe of observation can be either inside or outside a certain 
category, if it has or has not, respectively, the defining properties of the category in question. 
Further, all elements have equal standing in the category: there are no preferred 
representatives of a category - all or nothing membership. 

One other characteristic of the classical view of categorization has to do with an observer 
independent epistemology: realism or objectivism. Cognitive categories were thought to 
represent objective distinctions in the real world; say, divisions between colors, between 
sounds, were all assumed to be characteristics of the real world independent from any 
beings doing the categorizing. Frequently, this objectivism is linked to the way classical 
categories are constructed on all-or-nothing sets of objects: "if categories are defined only by 
properties inherent in the members, then categories should be independent of the 
peculiarities of any beings doing the categorizing" [Lakoff, 1987, page 7]. I do not subscribe 
to this point of view; we can use classical categories both in realist or constructivist 
epistemologies. Even with classical, all-or-nothing, categories, the properties are not 
inherent in the members, there is always something or someone defining the necessary list 
of properties. The question is who or what is to establish the shared properties of a 
particular category. A model where these shared properties are regarded as observer 
dependent, that is, established in reference to the particular physiology and cognition of the 
agent doing the categorizing, is built under a constructivist epistemology. If on the other 
hand, these properties are considered to be the ultimate truth of the real world, then the aim 
is the definition of an objectivist model of reality. 

Most modern theories of categorization include classical categories as a special case of a 
more complex scheme, which does not imply that some categories are objective and others 
are subjective. Thus, classical categories have to do with an all-or-nothing description of 
sets, based on a list of shared properties defined in some model. This external model is 
indeed built within an objectivist epistemology in the classical approach, but these two 
aspects of the classical theory of categorization are not necessarily dependent. The chosen 
structure of categories and the chosen model of knowledge representation/manipulation, 
which can be realist or constructivist, may be independent concerns when modeling 
cognitive categorization. 

2*2 Prototype Theory and Fnizzy Sets 

Rosch [1975, 1978] proposed a theory of category prototypes in which, basically, some 
elements are considered better representatives of a category than others. It was also shown 
that most categories cannot be defined by a mere listing of properties shared by all 
elements. Some approaches define this degree of representativeness as the distance to a 
salient example element of the category: a prototype [Medin and Schaffer, 1978]. More 
recently, prototypes have been accepted as abstract entities, and not necessarily a real 
element of the category [Smith and Medin, 1981]. An example would be the categorization of 
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eggs by Lorenz'[i98i] geese, who seem to use an abstract prototype element based on such 
attributes as color, speckled pattern, shape, and size. It is easy to fool a goose with a wooden 
egg if the abstract characteristics of the prototype are emphasized. 

Naturally, fuzzy sets became candidates for the simulation of prototype categories on two 
counts: (i) membership degrees could represent the degree of prototypicality of a concept 
regarding a particular category; (ii) a category could also be defined as the degree to which 
its elements observe a number of properties, in particular, these properties may represent 
relevant characteristics of the prototype. These two points are distinct. The first makes no 
claim whatsoever on the mechanisms of creation and manipulation of categories. It may be 
challenged, as I will do in the sequel, on the grounds that due to its simplicity, models using 
it must be extremely complicated. Nonetheless, it does offer the minimum requirement a 
category must observe: a group (set) of elements with varying degrees of representativeness 
of the category itself. 

The second point goes beyond the definition of a category and enters the domain of 
modeling the creation of categories. As in the classic case, categories are seen as groups of 
elements observing a list of properties, the only difference is that elements are allowed to 
observe these properties to a degree. However, the so called radial categories [Lakoff, 1987] 
cannot be formed by a listing of properties shared by all its elements, even if to a degree. 
They refer to categories possessing a central subcategory core, defined by some coherent (to 
a model or context) listing of properties, plus some other elements which must be learned 
one by one once different contexts are introduced, but which are unpredictable from the 
core's context and its listing of shared properties. Thus, the second interpretation of fuzzy 
sets as categories leads fuzzy logic to a corner which renders it uninteresting to the modeling 
of cognitive categorization. Notice that Rosch herself made a distinction between the notion 
of category prototypes and the notion of knowledge representation: 



"Prototypes do not constitute any particular processing model for categories [...]. What the 
facts about prototypicality do contribute to processing notions is a constraint ~ process 
models should not be inconsistent with the known facts about prototypes. [...] As with 
processing models, the facts about prototypes can only constrain, but do not determine, 
models of representation." [Rosch, 1978, pg. 40] 



Since fuzzy sets, at least to a degree, can be included in realist or constructivist frameworks, 
its dismissal as good models of cognitive categories has to be made on different grounds. In 
the following I will maintain that fuzzy sets are unsatisfactory because they (i) lead to very 
complicated models, (ii) do not capture all forms of uncertainty necessary to model mental 
behavior, and (iii) leave all the considerations of a logic of subjective belief to the larger 
imbedding model, which makes them poor tools in evolutionary constructivist approaches. 
A formal extension based on evidence theory is proposed next. 

2„3 Dynamic Categories 

As Hampton [1992] and Clark [1993] discuss, the important question to ask at this point is 
"where do the prototypicality degrees come from?" Barsalou [1987] has shown how the 
prototypical judgments of categories are very unstable across contexts. He proposes that 
these judgements, and therefore the structure of categories, are constructed "on the hoof" 
from contextual subsets of information stored in long-term memory. The conclusion is that 
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such a wide variety of context-adapting categories cannot be stored in our brains, they are 
instead dynamic categories which are rarely, if ever, constructed twice by the same cognitive 
system. Categories may indeed have Rosch's graded prototypicality structure, but they are 
not stored as such, merely constructed "on the hoof 1 from some other form of information 
storage system. 



"Invariant representations of categories do not exist in human cognitive systems. Instead, 
invariant representations of categories are analytic fictions created by those who study 
them." [Barsalou, 1987 p. 114] 



As Clark [1993] points out, since the evidence for graded categories is so strong, even in ad 
hoc categories such as "things that could fall on your head" or viewpoint-related categories, 
"it seems implausible to suppose that the gradations are built into some preexisting 
conceptual unit or prototype that has been simply extracted whole out of long-term 
memory." [Ibid, page 93] Thus, we should take the graded prototypical categories as 
representations of these highly transient, context-dependent knowledge arrangements, and 
not of models of information storage in the brain. In the following, the extensions of fuzzy 
sets proposed to model cognitive categories should be understood as such. As for the 
modeling of cognitive categorization itself, an attempt to model certain aspects of it is 
developed with the extended theory of approximate reasoning presented in section 7, which 
is used in a computational system of information retrieval outlined in section 9. 

3o Mathematical Background 

Let X denote a nonempty universal set under consideration. Let P(X) denote the power set 
of X. An element of X represents a possible value for a variable x. X can be countable or 
uncountable. 

3*1 Uncertainty 

George Klir [1993; Klir and Yuan, 1995] classifies uncertainty into two main forms: 
ambiguity and fuzziness. Ambiguity is further divided into the categories of nonspecificity 
and conflict. Mathematically ambiguity is identified with the existence of one-to-many 
relations, that is, when several alternatives exist for the same question or proposition. 
Nonspecificity is associated with unspecified alternatives, and conflict with the existence of 
several alternatives with some distinctive characteristic. Dempster-Shafer Theory (see 
below) provides an ideal framework for the study of ambiguity, as it enlarges the scope of 
traditional probability theory. Fuzziness is identified with lack of sharp distinctions. Fuzzy 
sets (see below) are usually used to formalize this kind of uncertainty. A measure of 
fuzziness is defined as the lack of distinction between a set and its complement [Yager, 1979, 
1980]. In [Rocha, 1997a, 1997b] measures of uncertainty needed to measure the information 
content of evidence sets presented next were developed. In particular, such measures were 
defined for both discrete and nondiscrete domains. Please refer to [Rocha, 1997a, 1997b] for 
a more detailed discussion of uncertainty. 

3o2 Dempstter-Shafer Theory of Evidence 

Evidence theory, or Dempster-Shafer Theory (DST) [Shafer, 1976], maybe defined in terms 
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of a set function m:P (X) [o, 1], referred to as a basic probability assignment, such that m 
(emptyset)=o and SUM m(_4)=i. The value m(A) denotes the proportion of all available 

evidence which supports the claim that A in P (X) approximately represents the actual value 
of our variable x. DST is based on a pair of nonadditive measures: belief (Bel) and 
plausibility (PI) uniquely obtained from m. Given a basic probability assignment m, Bel and 

PI are determined for all A in P (X) by the equations: 



J*(A) = £ m(B) 

BDA+o 

the expressions above imply that belief and plausibility are dual measures related by: 

P1(A) = 1 - Bel(_4 c ) 

for all A in P (XJ, where A° represents the complement of A in X. It is also true that Bel(A) < 

PICA) for all A P (X). Notice that [Shafer, 1976, page 38] , "m(_4) measures the belief one 
commits exactly to A, not the total belief that one commits to A. 11 Bel(_4), the total belief 
committed to A, is instead given by the sum of all the values of m for all subsets of A. 

Any set A in P (X) with m(A) > o is called Bifocal element. A body of evidence is defined by 

the pair (F, m), where F represents the set of all focal elements in X, and m the associated 
basic probability assignment. The set of all bodies of evidence is denoted by B. In the context 
of evidence theory, the universal set X is referred to as the frame of discernment Given two 
pairs of dual belief-plausibility measures, Bel^Pl^ Bel 2 -Pl 2 , over the same of frame of 

discernment X 9 but based on different bodies of evidence (F, m) v (F, m) 2 , the resulting, 

combined, body of evidence, (F, m) 1 , is defined by the following basic probability 
assignment: 

E 

m \^\ c ) - — — ^ 



E >«MK(3) 



where Fj 2 is the set of all non-empty subsets C of X resulting from the intersection of each 

focal element A i of F x with each focal element Bj of F 2 . This expression is referred to as the 
Dempster's rule of combination. 

3.3 Fuizzy Sets and Interval Valued Fuizzy Sets 
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A crisp set entails no uncertainty in its membership assessment: if an element x of Xis a 

member of a set A in X, then it will not be a member of its complement A c in X. A fuzzy set 
introduces fuzziness as the above law of contradiction is violated: x can both be a member 

(to a degree) of A and A° . A (standard) fuzzy set A is defined by a membership function 

A (x) . X [0,1] p UZZ y se ts can b e extended to interval valued fuzzy sets (IVFS): A(x): X -+ 

I([o,i])> where I represents the set of intervals in [o, l]. IVFS offer, in addition to fuzziness, 
a nonspecific description of membership in a set; and they do so with very little information 
requirements. An IVFS A, for each x in X captures two forms of uncertainty: fuzziness (as in 
the case of fuzzy sets) and nonspecificity. The Fuzziness of the membership degrees of 
standard fuzzy sets, is absolutely specific. When we create a fuzzy set we have perfect 
knowledge of the degree to which a certain element x of X belongs to A. In contrast, when 
we create an IVFS we have nonspecific knowledge of the degree of membership; hence the 
utilization of an interval to describe the membership of x in A. 

4o Setts and Cognitive Categorization 

4.1 Fuzzy Sets and the Prototype Combination Problem 

As previously discussed, fuzzy sets are actually fairly accurate representations of categories 
simply because they are able to represent prototypicality (understood as degree of 
representativeness); how the prototype degrees are constructed is, on the other hand, a 
different matter. Fuzzy sets are simple representations of categories which need much more 
complicated models of approximate reasoning than those fuzzy predicate logic alone can 
provide in order to satisfactorily model cognitive categorization processes. Critics [Osherson 
and Smith, 1981; Smith and Osherson, 1984; Lakoff, 1987] have shown that the several fuzzy 
set connectives (e.g. conjunction and disjunction) cannot conveniently account for the 
prototypicality of the elements of a complex category, which may depend only partially on 
the prototypicality of these elements in the constituent categories and may even be larger 
(or smaller) than in all of these. This is know as the prototype combination problem. 

A complex category is assumed to be formed by the connection of several other categories. 
Approximate reasoning defines the sort of operations that can be used to instantiate this 
association. Smith and Osherson's [1984] results, showed that a single fuzzy connective 
cannot model the association of entire categories into more complex ones. Their analysis 
centered on the traditional fuzzy set connectives of (max-min) union and intersection. They 
observed that max-min rules cannot account for the membership degrees of elements of a 
complex category which may be lower than the minimum or higher than the maximum of 
their membership degrees in the constituent categories. Their analysis is very incomplete 
regarding the full-scope of fuzzy set connectives, since we can use other operators [see 
Dubois and Prade, 1985], to obtain any desired value of membership in the [o, 1] interval of 
membership. However, their basic criticism remains valid: even if we find an appropriate 
fuzzy set connective for a particular element, this connective will not yield an accurate value 
of membership for other elements of the same category. Hence, a model of cognitive 
categorization which uses fuzzy sets as categories will need several fuzzy set connectives to 
associate two categories into a more complex one (in the limit, one for each element). Such 
model will have to define the mechanisms which choose an appropriate connective for each 
element of a category. No single fuzzy set connective can account for the exceptions of 
different contexts, thus the necessity of a complex model which recognizes these several 
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contexts before applying a particular connective to a particular element. Therefore, a model 
of cognitive categorization based solely on fuzzy sets and their connectives will be very 
complicated and cumbersome. 

The prototype combination problem is not only a problem for fuzzy set models, but for all 
models of combination of prototype-based categories. Fodor [1981] insists that though it is 
true that prototype effects obviously occur in human cognitive processes, such structures 
cannot be fundamental for complex cognitive processes (high level associations): "there 
may, for example, be prototypical cities (London, Athens, Rome, New York); there may even 
be prototypical American Cities (New York, Chicago, Los Angeles); but there are surely not 
prototypical American cities situated on the east coast just a little south of Tennessee.' 1 [Ibid, 
page 297] As Clark [1993] points out, the problem with Fodor's point of view, and indeed 
the reason why fuzzy set combination of categories fails, is that "he assumes that prototype 
combination, if it is to occur, must consist in the linear addition of the properties of each 
contributing prototype." [Ibid, page 107] Clark proposes the use of connectionist prototype 
extraction as an easy way out of this problem. In fact, a neural network trained to recognize 
certain prototype patterns, e.g. some representation of "tea" and "soft drink", which is also 
able to represent a more complex category such as "ice tea", "does not do so by simply 
combining properties of the two 'constituent' prototypes. Instead, the webs of knowledge 
structure associated with each f hot spot 1 engage in a delicate process of mutual activation 
and inhibition." [Ibid, page 107] In other words, complex categories are formed by 
nonlinear, emergent, prototype combination. 

As Clark points out, however, this ability to nonlinearly combine prototypes in connectionist 
machines is a result of the pre-existence of a Qoosely speaking) semantic metric which 
relates all knowledge stored in the network. Through the workings of the network with its 
inhibition and activation signals, new concepts can be learned which must somehow relate 
to the existing knowledge previously stored. Therefore, any new knowledge that a 
connectionist device gains, must be somehow related to previous knowledge. This 
dependence prevents the sort of open-ended conceptual combination that we require of 
higher cognitive processes. 

This problem might be rephrased by saying that connectionist devices can only make 
nonlinear prototype combinations given a small number of contexts. The brain may use a 
network to classify, say, sounds, another one images, and so forth. In their own contexts, 
each network combines prototypes into more complex ones, but they cannot escape their 
own contexts. I believe, with Clark, that connectionist machines are nonetheless very 
powerful, even given these constraints. The approach I am about to follow, is not proposed 
to be used instead of connectionist devices, but one that may offer a higher level treatment 
of the contextual problem in prototype combination. In fact, in section 9, a computational 
model is presented that even though not using connectionist machines in the strong sense 
[van Gelder, 1992], uses networked relational databases that also possess distributed 
semantic semi-metrics and which can approach this contextual problem. 

4o2 Interval Valued Fuzzy Sets 

As discussed in the previous section, approximate reasoning does not model effectively the 
combination of prototypical categories. It can only work on very limited contexts, whose 
categories can be formed from the linear combination of constituent categories. The 
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Introduction of a theory of approximate reasoning based on interval valued fuzzy sets 
[Gorzaczany, 1987; Turken, 1986] represents a step forward in the modeling of cognitive 
categorization, as it offers a second level of uncertainty, but it only slightly improves the 
contextual problem referred above. The membership degrees of IVFS are nonspecific (see 
section 3.3). This second dimension of uncertainty allows us to interpret the interval of 
membership of an element in a category as the membership degree of this element 
according to several different contexts, which we cannot a priori identify. 

In particular, Turksen's concept combination mechanisms are based on the separation of 
the disjunctive and conjunctive normal forms of logic compositions in fuzzy logic. A 
disjunctive normal form (DNF) is formed with the disjunction of some of the four primary 
conjunctions, and the conjunctive normal form (CNF) is formed with the conjunction of 
some of the four primary disjunctions, respectively: 

At)B. Af\B, Af\B, AdB and AUB, AUB, AUB, lUS j n two-valued logic the CNF and 
DNF of a logic composition are equivalent: CNF = DNF. Turksen observed that in fuzzy 
logic, for certain families of conjugate pairs of conjunctions and disjunctions, we have 
instead DNF c CNF for some of the fuzzy logic connectives. He then proposed that fuzzy 

logic compositions could be represented by IVFS's given by the interval [DNF, CNF] of the 
fuzzy set connective chosen [Turksen, 1986]. With IVFS based connectives, Turksen was 
able to deal more effectively with the shortcomings of a pure fuzzy set approach. In his 
model, two fuzzy sets are combined into an IVFS. The fuzzy and nonspecific degrees of 
membership of the elements in the category obtained, can be interpreted as inclusion in a 
category according to several possible, fuzzy degrees. 

Turksen's model simplifies the pure fuzzy set approach since we will find more categories 
which can be combined into complex categories with a single connective used for all 
elements of the universal. The IVFS approach provides a way to acknowledge the existence 
of contextual nonspecificity in complex category formation, thus producing a more accurate 
representation of different forms of uncertainty present in such processes. The problem is 
that categories demand membership values which more than nonspecific can be conflicting. 
That is, the contextual effects may need more than an interval of variance to be accurately 
represented. Also, even though IVFS use nonspecific membership, thus allowing a certain 
amount of contextual variance, the several contexts are not explicitly accounted for in the 
categorical representation. Section 5 proposes set structures which (i) capture all 
recognizable forms of uncertainty in their membership representation, (ii) point ex plicitly to 
the contexts responsible for a certain facet of their membership representation, and (iii) in 
so doing, introduce a formalization of belief. 

5 Evidence Setts § Membership, Belief 9 and Context 

An alternative way to represent an IVFS A is to consider that for every element x of X, there 
is a body of evidence (F * m*) defined on the set of all intervals of [0,1], I, with a single focal 

I* = [/ * 1 * 1 c [0 11 

element given by the interval ^ sup ' . The basic probability assignment 

function m x assumes the value 1 for this single focal element, representing our belief that 
the degree of membership of element x of X in A is (with all certainty) in the sub-interval I x 
of "[0, 1]. In other words, out judgement of the (nonspecific) degree of membership, I x , bfx 
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in set .A indicates that we fully believe it is correct. Notice that the universal set of the IVFS 
is X, but the universal set of the body of evidence is the unit interval [o, 1]. It is now clear 
that an IVFS is a very special case of a more general structure which I refer to as evidence 
set [Rocha, 1994, 1995, 1997a]. An evidence set A ofX, is defined by a membership function 
of the form: 

A(x):X ->B[o,i] 

where, B[o, 1] is the set of all possible bodies of evidence (F x , m*) on I. Such bodies of 

evidence are defined by a basic probability assignment m x on X, for every x in X. Thus, 
evidence sets are set structures which provide interval degrees of membership, weighted by 
the probability constraint of DST. They are defined by two complementary dimensions: 
membership and belief. The first represents a fuzzy, nonspecific, degree of membership, and 
the second a subjective degree of belief on that membership, which introduces conflict of 
evidence as several, subjectively defined, competing membership intervals weighted by the 
basic probability constraint are created (focal intervals). Figure 1 depicts a non-consonant 
[Rocha, 1995] evidence set with three focal elements. 



1 




Fi»<uirv 1: Xon-ounsoiiaiii evidence sel will lliree fixai flercieiils 

The interpretation I suggest for the multiple intervals of evidence sets, defines each interval 

of membership I*, with its correspondent evidential weight m x ( Jy*), as the representation of 

the prototypicality of a particular element x of X in category A according to a particular 
perspective. Thus, each element x of an evidence set A has its membership defined as 
several intervals representing different, possibly conflicting, perspectives. An IVFS refers to 
the case where we have a single perspective on the category in question, even if it admits a 
nonspecific representation (an interval). The ability to maintain several of these 
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perspectives, which may conflict at times allows a model of cognitive categorization or 
knowledge representation to directl y access particular contexts affecting the definition of a 
particular category, which is essential for radial categories. In other words, the several 
intervals of membership of evidence sets refer to different perspectives which explicitly 
point to particular contexts. 

The degrees of belief on which evidence theory is based do not aspire to be objective claims 
about some real evidence, they are rather proposed as judgements, formalized in the form of 
a degree [Shafer, 1976, page 21]. Likewise, Rosch's prototypes are not assumed to be an 
objective grading of concepts in a category, but rather judgements of some uncertain, highly 
context-dependent, grading [Rosch, 1978, page 40]. Evidence sets offer a way to model 

these ideas since an independent^, unconstrained, membership grading of elements 
(concepts) in a category is offered together with an explicit formalization of the belief 
posited on this membership. For evidence sets, membership in a category and judgments 
over membership are different, complementary, qualities of prototypicality. None of the 
other structures so far presented is able to offer both an independent characterization of 
membership and a formalization of judgments imposed on this membership. Traditional set 
structures (crisp, fuzzy, or interval-valued) alone offer only an independent degree of 
membership, while evidence theory by itself offers primordially a formalization of belief 
which constrains the elements of a universal set with a probability restriction (more on this 
in section 8). 

Regarding the previously discussed connectionist extraction of prototypes, notice that 
evidence sets, as any set structure, have independent, unconstrained membership. 
Connectionist prototypes are implicitly defined by a semantic metric constraining the 
elements of the categorizing universe. The existence of such metrics may be very important 
for cognitive categorization. However, evidence sets are merely proposed as models of 
cognitive categories, it is up to the model of cognitive categorization to supply additional 
constraints such as semantic metrics. As a higher level structure, it is very important that 
Evidence Sets do not have such constraints a priori, in fact, it is precisely their advantage 
over connectionist devices which are not flexible enough to allow users to arbitrarily change 
constraints and contexts on prototype-based categories. In section 7, approximate reasoning 
methods are proposed which shall be used in Section 9 to define an information retrieval 
system that in turn constrains Evidence Sets with context-specific semantic metrics. 

60 Evidence Sets and Uncertainty 

A fuzzy set captures fuzziness in a specific way; an IVFS introduces nonspecificity; a 
consonant evidence set (nested focal intevals) introduces grades or shades of nonspecificity; 
and finally, a nonconsonant evidence set introduces conflict as we have cases where the 
degree to which an element is a member of a set is represented by disjoint focal intervals of 
[o, 1] with different evidential strengths. The three forms of uncertainty are clearly present 
in human cognitive processes. More than simply measuring fuzziness, as approximate 
reasoning models do, models of uncertain reasoning based on evidence sets need to 
effectively measure all the three uncertainty forms. Hence, we need a 3-tuple of measures of 
the 3 main kinds of uncertainty to aid us in the decision making steps of our uncertain 
reasoning models: {Fuzziness, Nonspecificity, Conflict). [Rocha et al, 1996; Rocha, 1997a, 
1997b]. 



http://www.c3.lanl.gov/~rocha/es_ijgs.html 



4/21/04 



Evidence Sets: Modelling Subjective Categories 



Page 12 of 29 



The three forms of uncertainty define a 3 dimensional uncertainty space for set structures, 
where crisp sets occupy the origin, fuzzy sets the fuzziness axis, IVFS the fiizziness- 
nonspecificity plane, and evidence sets most of the rest of this space. The total uncertainty, 

£7, of an evidence set A is defined by: U ^ = f 7 ^' 7 ^^ 7 ^). The three indices of 
uncertainty, which vary between 1 and o, IF (fuzziness), IN (nonspecificity), and IS (conflict) 
were introduced in [Rocha, 1996a, 1997a, 1997b], where it was also proven that IN and IS 
possess good axiomatic properties wanted of information measures. For a complete 
discussion, please refer to [Rocha et al, 1996; Rocha, 1997a, 1997b]. 

7o BeMef-Coesttraiiniedl Approximate Reasoning 

7.1 Uncertainty Increasing Operations Between Evidence Sets 

The operations of complementation, intersection, and union are the most basic connectives 
in a theory of approximate reasoning. Here I discuss only these operators, since all other 
connectives can be easily constructed from these. Naturally, complementation, intersection, 
and union as defined below for evidence sets subsume, as special cases, the same operations 
for IVFS and fuzzy sets. 

7.1.1 Complementation 

The interval valued membership function of elements of X in an IVFS A is given by: A(x) = 
mp sup > ^ Its com pi em ent can be defined as the negation of the interval 

a c (x) = (i x y = \i-i x 

limits in reverse order: w " v ' " 1 *** ^ [Gorzaczany, 1987]. The 
membership function of an evidence set A oiXis given, for each x, by n intervals weighted 
by a basic probability assignment m x \ 



A(x) - {{/> 1 %W>"-,( J >"')} 



The complement of an evidence set [Rocha, 1997a, 1997c] is defined as the complement of 
each of its interval focal elements with the preservation of their respective evidential 
strengths: 

A'(x) - {((V)>'M^'>"4"#)'>™»}} 

7.1.2 Intersection 

The intersection of two IVFS [Gorzaczany, 1987] is defined as the minimum of their 
respective lower and upper bounds of their membership intervals. Given two intervals of [o, 

1] ^ ^ C ^ and ^ ^ L , the minimum of both intervals is an interval 

v ' ' L v L " L/y Ku> UJ . Given two evidence sets A and B defined for 
each x of Xby: 
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and 



where 7^ and Jj are intervals of [o,i]. Their intersection is an evidence set C(x) = A(x) B(x) 9 
whose intervals of membership K k and respective basic probability assignment m^K^) are 
defined by: 



7*1*3 Union 

The union of two IVFS [Gorzaczany, 1987] is defined as the maximum of their respective 
lower and upper bounds of their membership intervals. Given two intervals of [0, 1] 



7*1*4 Increasing Uncertainty 

By utilizing the connectives (5) and (6), the uncertainty of our models tends to increase, as 
two bodies of evidence on the unit interval are combined into a new one, by preserving most 
perspectives (contexts) involved. There are at least as many intervals in the combined set as 

the minimum of intervals in the combining sets. In other words, if i x and j x represent the 
number of intervals (perspectives) present, respectively, in combining sets A and B for 

element x> then the combined set C will have at least MIN( | r* | , | j x | ) intervals for concept 
x. An alternative to this way of combining evidence sets is described below. 

7o2 Uncertainty Decreasing Operation Between Evidence Setts 

We can combine evidence sets by preserving all their perspectives (though with reduced 
weights as the joined basic assignment must still add up to 1) as above, thus increasing the 
uncertainty complexity, or we can combine them only according to the coherent 
perspectives (those aiming at the same intervals) by utilizing Dempster's rule of 
combination (1) presented in section 3.2 , and decrease the uncertainty complexity. Given 
two evidence sets A and B defined by (3) and (4), their uncertainty decreasing combination 
is an evidence set C(x) = A(x) □ B(x), whose intervals of membership and respective 

basic probability assignment m^K^) are defined by: 
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c * 1 - K 

for K£*®> where K = E m A(^ X )' m B(^/) 



This operation eliminates all focal elements which do not coincide (or intersect) in both 
bodies of evidence being combined, while the operations of section 7.1 maintain some 
evidential weight for these, though enhancing those that do intersect. 

Dempster's rule of combination is used to combine different bodies of evidence over the 
same frame of discernment. It is an all or nothing rule, that is, if the focal elements of two 
distinct bodies of evidence being combined are disjoint, no combination is possible. In this 
situation, in DST, if we still consider that there is relevant interaction between the two 
bodies of evidence which our frame of discernment cannot capture, then we either rethink 
our basic probability assignments or the frame of discernment is changed by introducing 
new elements common to both bodies of evidence. Now consider that our model of 
categorization, by utilizing Dempster's rule, reaches a combination of categories whose 
bodies of evidence are completely incoherent. That is, no new category is obtainable. If this 
result is reached in some intermediate step of an approximate reasoning process, the 
process is naturally stopped. To be able to continue with this process, we have to obtain 
some transitional category. Since the frame of discernment of the belief attributes of an 
evidence set is the membership unit interval, we cannot aim to refine it in any way. For this 
reason, I have proposed uncertainty decreasing and increasing operations for evidence sets. 
If the evidence sets being combined are at least partially coherent, we can use Dempster's 
rule which will reduce the uncertainty present. If this coherency is not attainable, we can 
choose an uncertainty increasing operation which largely maintains the evidence from both 
structures being combined, until a more coherent state of evidence is encountered at a later 
stage. 

The uncertainty decreasing operation can be used when we have coherent evidence of 
membership in combining evidence sets, and when we wish to reduce dramatically the 
amount of uncertainty present in some simulation of human reasoning processes. In an 
artificial system, this operation might be identified we fast decision-making processes. Say, 
if we possess two categories which must be combined in order to make a fast decision, then 
uncertainty must be reduced and the most coherent result chosen. On the other hand, if we 
do not have coherent membership evidence, or if we do not need to engage in fast decision 
making, but instead desire to search for more conflicting, far-fetched, associations (from 
wildly different contexts), then the uncertainty increasing operations should be chosen. 

So Evidence Setts and Evidence Theory 

So far I have discussed set structures as models of cognitive categories, from crisp sets to 
evidence sets I have stressed that any mathematical model of cognitive categories must offer 
(i) degrees of inclusion in the category/set, (ii) an accurate account of uncertainty forms in 
their membership values, and (iii) a way in for context-dependencies and subjective aspects 
of categories. I have proposed that evidence sets fulfill these three requirements. A natural 
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question now is, why is DST not enough by itself to effectively model cognitive categories? 
We can think of the frame of discernment of DST as the universe of possible values for a 
variable x representing the possible elements (or concepts) of a universe of discourse. A 
category can be defined as a body of evidence defined on such universe. Each focal element, 
can be seen as a possible perspective for the category. 

8.1 Upper and Lower Probabilities Interpretation 

Let us consider that a category is defined by a body of evidence (F, m) on a universal set X. 

In other words, the category will be defined by a set F of subsets of X (focal elements) with 
associated basic probability assignment m. Plausibility and belief measures can be 

constructed from (F, m) as defined in section 3.2. Following Dempster's [1967] original 
interpretation of plausibility and belief measures as upper and lower probabilities, 
respectively, we can understand these probability limits as offering a nonspecific (interval- 
valued) membership of subsets of X in the category, which would satisfy the first 
requirement above. Nonetheless, several problems are encountered with this model of 
categories. First, notice that the basic probability assignment values must add up to one (see 
section 3.2), this constrains the category as it introduces a dependency on its elements. That 
is, because of the probabilistic constraint, the value of membership of an element, which 
would be given here by the belief-plausibility interval, would be constrained by the value of 
membership of other elements. Specifically, their individual membership is not free to 
attain any value as it is desired of a set structure or a cognitive category. Furthermore, 
membership in a category is not attributed to singletons but to subsets of the universal set. 
In addition, the second and third requirements are not satisfied as conflict is not captured, 
and no account of context is included, in the individual membership values. 

80 2 Belief Interpretation 

Consider now that a category is still defined by the body of evidence (F, m), only now, more 
in line with Shafer's [1976] interpretation, the basic probability assignment function m will 

identify the portions of belief ascribed exactly to the focal elements F. This way, each exact 
portion of belief and its associated focal element can be related to a particular context in a 
larger imbedding model. In other words, the sort of categories we obtain with this 
interpretation are formed by crisp subsets of the frame of discernment with associated belief 
values: membership is all or nothing, but belief is graded. In a way, we have classic 
categories with an account of belief, subjectivity, and a way in for context-dependencies in a 
larger model of categorization. Clearly, this interpretation satisfies the third requirement 
but not the first and the second. 

8«3 Generalized Deimipster-Sliafer Theory 

Several ways of extending the DST to a fuzzy set framework have been proposed. Probably 
the most general and well known approach is John Yen's [1990] generalization. Basically, 
the idea is to move from crisp to fuzzy focal elements. In this case, we no longer have 
classical categories, as degrees of membership are introduced, thus satisfying the first 
requirement in addition to the third requirement already satisfied by the second 
interpretation of evidence theory in the previous section. Naturally, to satisfy the second 
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requirement, that is, to obtain an accurate account of uncertainty forms in the membership 
degrees of a set/category's elements we can extend the fuzzy focal elements to interval- 
valued focal elements, or even more generally to sets of fuzzy sets. This seems to satisfy all of 
the three requirements above, so, why are evidence sets preferable over generalized 
evidence theory as models of categories? The next subsection should answer this question. 

804 Evidence Setts s Independent Membership 

Evidence sets have unconstrained membership; that is, the values of membership for each 
element x of the universal set X are independent of each other. In contrast, the categories 
defined solely with evidence theory in the previous sections, are set oriented, that is, they 
define categories with focal elements which are subsets of X. Thus, the evidence a particular 
context offers is associated with a set of singletons rather than with a singleton itself. 
Naturally, a singleton can also be represented by a set, but if focal elements are singletons, 
then we will need many focal elements to represent a category, and since their respective 
evidential weights given by the basic probability assignment must add up to one, each 
singleton will necessarily have a small degree of belief associated with it. In other words, the 
belief we have that a certain singleton belongs to a category, will be dependent on the belief 
we ascribe to other singletons. This kind of dependence is not desirable of a model of a 
category. The inclusion of an element in a category should not necessarily be dependent on 
other elements already included in it. A larger model of categorization may impose these 
constraints at a higher level, but the basic mathematical structures used should not impose 
them at the onset. 

An evidence set allows a complete separation of membership and belief between elements in 
a category since an account of belief is not used to constrain the elements of the universal 
set but to constrain their respective membership values in the unit interval. Thus, the 
membership/belief of an element x is independent from that of another element y. It is 
important to realize that belief is still constrained/or each individual membership 
qualification, in other words, the basic probability assignment used to qualify the possible 
intervals of membership, must still add up to one. With this independent quantifiability of 
membership/belief for each element in a universal set, the contexts that affect an element's 
membership in a category can be completely different from element to element, a desirable 
characteristic for radial categories. 

<9o Competing Categories in Information Retrieval 

In this section a conversational, collaborative, adaptive, knowledge management system for 
databases that uses evidence sets as categorization mechanisms is presented. Its objective is 
the definition of a human-machine interface that can capture more efficiently the user's 
interests through an interactive question-answering process. It also attempts to model 
certain aspects of cognitive categorization processes that use linguistic categories as higher- 
level short-term constructs generated by lower-level connectionist memory banks. The 
model offers an expansion of Nakamura and Iwai ? s [1982] data-retrieval system which is 
expanded from a fuzzy set to an evidence set framework. The evidence set expansion allows 
the construction of categories from several databases simultaneously. 

Each database is characterized by a network structure with two different kinds of objects: 
Concepts x { (e.g. Keywords) and Properties p f (e.g. data records like books). Each concept is 
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associated with a number of properties which may be shared with other concepts. Based on 
the amount of properties shared with one another, a measure of similarity, s, can be 
constructed for concepts x i and Xy 

where NOc^ represents the number of properties that directly qualify concept x i9 N(xj) 
represents the number of properties that directly qualify concept Xp N(x f u * ; 0 represents the 
number of properties that directly qualify both x i or Xj, and n xj) represents the number 
of properties that directly qualify either x t - or Xj. The inverse of the similarity, s, creates a 

measure of distance^, d: 

The distances between directly linked concepts are calculated using (9). After this, the 
shortest path is calculated between indirectly linked concepts. The algorithm allows the 
search of indirect distances up to a certain level. The set of n-reachable concepts from 
concept is the set of concepts that have no more that n direct paths between them. If we 

set the algorithm to paths up to level n, all concepts that are only reachable in more than n 
direct paths from x i will have their distance to x i set to infinity. 



9.1 The Long-Term Networked Memoiry Sttractare 

The Local Knowledge Context X k is the substructure of database k defined solely by the 

concepts and their relative distance d k as constructed with the semi-metric (9). Its purpose 

is to capture human knowledge by keeping a record of relationships between concepts, as 
well as a measure of their similarity. It is not a connectionist structure in the strong sense 
that concepts are not superposed [van Gelder, 1992] over the network but localized in 
recognizable nodes. However, in addition to localized nodes it does possess a distributed 
semi-metric space relating all knowledge as desired of connectionist memory [Clark, 1993]. 
This space is the lower-level structure of the system, the long-term memory of the database. 
It is from this semantic semi-metric that temporary prototype categorizations can be formed 
to model the "on the hoof 1 categories previously discussed. 

The system's relations are unique to it, and reflect the actual semantic constraints 
established by the set of properties (data records) it stores. Thus, the semantic semi-metric 
defined by (9), reflects the actual inter-significance of concepts (keywords) for the system 
and its users. The same concept in different databases will be related differently to other 
concepts, because the actual properties stored will be distinct. The properties a database 
stores are a result of its history of utilization and deployment of information by its users. In 
this sense, the long-term networked memory structure reflects a unique subjectivity 
developed by the history and dynamics of information storage and usage. Thus, each local 
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knowledge space X k from database k captures the knowledge that its community of users 

have accumulated in some area. Figure 2 depicts such structure with two different relational 
databases. 




FBguire 2; Stnicturo of 2 distinct databases that possess at least some fccy-woida in oonuiioji. A diffcrer 
disUuiw swiri-iiielric is constriidtx] for each one 



The Total Knowledge Space X of this structure is the set of all concepts in the n d included 
databases, that is: 

x- u x k 

Furthermore, the system has n d different distance semi-metrics, d k , associated with it. Each 

distance semi-metric is still built with equation (9) for some acceptable level of n-reachable 
concepts. But since each of the n d databases has a different concept-property pattern of 

connectivity, each distance semi-metric d k will be different. When a concept exists in one 

database and not on another, its distance to all other concepts of the second database is set 
to infinity. If the databases reflect similar communities of users, naturally their distance 
semi-metrics will tend to be more similar. This distinction between the several local 
knowledge contexts provides the system with intrinsic contextual conflict in evidence. 

<9>o2 Short Term Categorization Processes 

With their several intervals of membership weighted by the basic probability assignment of 
DST, evidence sets can be used to quantify the relative interest of users in each of the 
knowledge contexts stored in the n d databases. Given the underlying relations imbedded in 

the knowledge space, the system uses a question-answering process to capture the interests 
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of users in terms of this relational structure. In other words, the system constructs its own 
internal categories in interaction with the community of users. The extended evidence set 
approximate reasoning operations of intersection and union can be used to define such a 
conversational process. 

The system starts by presenting users with the several networked databases available, who 
have to probabilistically grade them. That is, weights must be assigned to each database 
which must add to one (in order to build basic probability assignment functions). The 
selected databases define the several contexts which the system uses to construct its 
categories. Once this is defined, the question-answering algorithm is as follows: 



1. The user selects the n d databases of interest and their respective weights m k . 

2. The user inputs an initial concept of interest (one of the key-words) jc. e X. 

3. The system creates an evidence set membership function centered on x i and 

affecting all its close neighbors using a construction defined below (equations (10) 
to (14)). This resulting evidence set of X represents a category that keeps the user's 
interests in terms of the system's own relations: The learned category A(x). 

4. The system calculates the total uncertainty of the learned category in its forms of 
fuzziness, nonspecificity, and conflict (as discussed in section 6). If total 
uncertainty is below a pre-defined small value the process stops, otherwise 
continue. 

5. Another concept Xj G X is selected. Xj is selected in order to potentially minimize 

the uncertainty of the learned category, that is, the most uncertain concepts with 
the most uncertain neighborhoods are selected. 

6. The user is asked whether or not she is interested in Xj. 

7. If the answer is "YES" another membership function as defined by (14) is created 
over Xj, and an evidence set union is performed with the previous state of the 

learned category. 

8. If the answer is "NO" the inverse of (14) is created over j^, and an evidence set 

intersection is performed. 

9. The system calculates the total uncertainty of the learned category in its forms of 
fuzziness, nonspecificity, and conflict. 

lb. If the uncertainty of the learned category is smaller than half the maximum value 
attained previously, the system stops since the learned category is considered to 
have been successfully constructed. Otherwise computation goes back to step 5. 



Several approaches can be used to define evidence set membership functions for the 
algorithm above. The scheme I follow here starts by building bell-shaped fuzzy membership 
functions for each of the n d distance semi-metrics d fc of X [Nakamura and Iwai, 1982]. Thus 

we obtain n d different fuzzy subsets of X defined by fuzzy membership functions for 1 YES" 

or "NO" responses given to concept x i as follows: 



c > 
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and 



where the parameter controls the spread of the bell-shaped functions. 

The next step is the construction of IVFS from these n d fuzzy sets, using Turksen's DNF c 
CNF combinations (see section 4.2). All pairs of the n d fuzzy sets given by either (10) or (11) 

for the "YES" or "NO" case respectively are combined to obtain ^ d " *^' 2 IVFS for the 

union combination and ^* d n ^ for the intersection combination. Each pair of fuzzy sets 
is combined with the CNF and DNF forms of disjunction (union) and conjunction 
(intersection) in order to form two IVFS whose respective intervals of membership are 
defined by the DNF c CNF bounds for the standard union and intersection. Thus, from n d 

fuzzy sets we obtain n * " d IVFS. Since the "YES" and "NO" functions are combined in 
exactly the same way, in the following I define the IVFS combination for a series of n d fuzzy 

set membership functions that can refer to either 1 YES" or "NO". Formally, a pair of fuzzy 
set membership functions (for semi-metrics d k and d,) is combined to obtain two IVFS: 



DNF 



CNF 



for union, and 



' DNF ' CNF 



for intersection, where for two fuzzy sets 
line denotes set complement): 

a n b 

DNF 

Af] B 

CNF 

AUB 

DNF 
AUB 
CNF 



{x), B(x) the following definitions apply (the over 
A H B 

(AUB) fl (AUB) (1 (AUB) 

(Af)B) U (Af\B) U (Af)B) 
AUB 



n 2 -n 

The final step is the construction of an evidence set from the d d IVFS obtained from 
(12) and (13). At the onset, the user specifies the relative weight of the n d databases utilized, 
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m fc , which form a probability restriction since the sum of all m fc for k=i...n d must equal one. 

When two fuzzy sets and f ^ , with relative weights m fc and m ; respectively, are 

combined with (12) and (13) to obtain two IVFS, the total weight ascribed to this pair of 
IVFS is (m k + mp/(n d - 1), and half of this quantity to each IVFS, which guarantees that the 

several IVFS are weighted by a probability restriction. Thus, if we have n d databases, with 

probability weight m k (fc=i...n d ), the evidence set membership function for an answer 'YES" 

to concept x i of knowledge space X, is given by: 



m k +m i 

2K" 1 ), 



\ k t l=l...n A 



n 2 -n 

that is, the evidence set has d d focal intervals constructed from (12) and (13), weighted 
as described above. When several focal intervals coincide, their weights are summed and 
only one interval is acknowledged. The procedure for the "NO" evidence set is equivalent. 
Figure 3 depicts the construction of the "YES" evidence set membership function for a case 



of n d =2. 



2 Databases with equal weight: 
n d = 2, w2;=m P =0.5. Haeh database has its 
own semi-metric d, and d 2 . 




X; (Keyword) 



IrnlcrmcdiaU; Fuzzy Seta 
Associated wiOh each Dalabase 



A liS. a:/ 




x.; (Keyword) 



YES Evidence Set l"he weighLs 0 
busk probability assignment are 0 
both intervals (n^ I m^/(2 *1 ) 



F1gnio'«> 3: F.vidence set membership function for answer -''YEST to concept x> 

The two different semi-metrics d x and d 2 for the knowledge space X cause the category 
constructed for the "YES" answer to concept x { to be more than just fuzzy, also nonspecific 
and conflicting. It is important to stress that this more accurate construction of prototypical 
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categories includes more uncertainty forms as a result of structural differences in the 
information stored in the several distributed memory contexts utilized. It is the lower level 
conflicts of long-term memory that the short-term construction of categories tailored by 
users reflects. This algorithm, implements many of the, temporary, "on the hoof [Clark, 
1993] category constructions ideas as discussed previously. In particular, it is based on a 
long-term memory bank of semantic relations that reflects the conceptual relationships of 
the community of users. Prototype categories are then built using evidence sets which reflect 
such consensually built relational metrics and the directed interest of a particular user at a 
particular time. 



9«3 Document Retrieval 



After construction of the learned category A(x), the system must return to the user the 
properties (data records such as books) relevant to this category. Notice that every property 
p i defines a crisp subset of the total knowledge space X whose elements are all the concepts 

to which p i is directly connected in any of the constituent databases. Let this subset be 

represented by . Since each property defines a crisp subset of X, the similarity between 
this crisp subset and the evidence subset defined by the learned category is a measure of the 
relevance of the property to the learned category. One way to define this measure of 
similarity is to approximate the evidence set category to its closest fuzzy set by a process of 
elimination of nonspecificity and conflict. Once this fuzzy set is obtained the following 
measures of similarity between properties and learned categories can be defined: 



and 



*2<Pi) = 



E S (x) 



E^(*)nyx) 



R x yields the fuzzy cardinality of the fuzzy set given by the intersection of the learned 

S 00 

category A(x) with Pl over the cardinality of the latter: it is an index of the subsethood of 

Pl in A(x) . The more Pi is a subset of A(x), the more relevant p i is. As long as Pl is 
included to a large extent in A, the property p i will be considered very relevant, even if the 

S (x) 

learned category contains many more concepts than those included in p * . This way, R 

gives high marks to all those properties who form subsets of the learned category and not 
necessarily those properties that qualify (are related to) the entire learned category as a 
whole. It is an index that emphasizes the independence of the concepts of the learned 
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category. It should be used when the cardinality of A(x) is large, otherwise, very few 
properties will exist that qualify such large set of concepts. 

R 2 , on the other hand, yields the fuzzy cardinality of the fuzzy set given by the intersection of 

S (x) 

the learned category A(x) with Pl over the cardinality of the former: it is an index of the 

S(x) S (x) 

subsethood of A(x) in p * . The more A(x) is a subset of Pi , the more relevant p z - is. This 

way, R 2 gives high marks to all those properties who form subsets that include the learned 

category as a whole. It is an index that emphasizes the dependence of the concepts of the 
learned category. It should be used when the cardinality of A(x) is small. 

Thus, after the system finishes its construction of the learned category A(x), the user can 
select one of the indices given by (15), (16), or a combination of the two and a value between 
o and 1. High values will result on the system returning only those properties highly related 
to A(x) according to the index chosen. Lower values will result in many more items being 
included in the list of returned properties. 

9«4 Adaptive Alteration of Long-Term Structure by Short-Term 
Categorization 

It is also desirable to provide this system with a mechanism to adapt the long-term 
relational structure, the knowledge space, according to the system's interactions with its 
users. Due to the properties (data records) it stores, the system may fail to construct strong 
relations between concepts (keywords) that its users find relevant. Therefore, the more 
certain concepts are associated with each other, by often being simultaneously included with 
a high degree of membership in learned categories, the more the distance between them 
should be reduced. An easy way to achieve this is to have the values of N(xj) and N(x i9 xj) as 

defined in (8), adaptively altered for each of the constituent n d databases. After an evidence 

set learned category is constructed and reduced to a fuzzy set A(x), these values can be 
changed to: 

A&W = A&*W + A*)> k=l...n d9Xi €X 

and 

respectively (t indicates the current state and t+i the new state). This implements an 
adaption of the system to its users according to repeated interaction. Thus, the system 
though constructing its categories according to its own distributed long-term memory, will 
adapt its constructions as it engages in question-answering conversations with its users. The 
direction of this adaptation leads the system's relational structure to match more and more 
the expectations of the community of users with whom the system interacts. In other words, 
its constructions are consensually selected by the community of users. Furthermore, when 
two highly activated concepts in the learned category are not present in the same database 
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(each one exists in a different database) they are added to the database which does not 
contain them, with property counts given by equations (17) and (18). If the simultaneous 
activation keeps occurring, then a database that did not previously contain a certain 
concept, will have its presence progressively strengthened, even though such concept does 
not really possess any properties in this database. 

If we regard the system's learned categories, implemented as evidence sets, as linguistic 
prototypical categories, which are the basis of the system's communication with its users, 
then such categories are precisely a mechanism to achieve the structural perturbation of its 
long-term distributed memory in order to lead it to increasing adaptation to its 
environment. In addition, short-term memory not only adapts an existing structure to its 
users, but effectively creates new elements in different, otherwise independent, relational 
databases, solely by virtue of its temporary construction of categories This way, linguistic 
categories function as a system of consensual structural perturbation of distributed memory 
banks, capable of transferring information across different contexts. This pragmatic 
adaptation to an environment has been argued to function as a model of an evolving 
semiosis between cognitive systems and their environments which validates a position of 
Evolutionary Constructivism [Henry and Rocha, 1996; Rocha, 1997a, 1997b]. 

<9>o5 TalkMinet The Implemented Application 

An application named TalkMine was developed that implements the above specified system. 
The example shown below refers to a database of 150 books. From the pool of 150 books 
three databases were created by randomly picking books from this pool with equal 
probability. Each sub-database is comprised of about 50 books, some of which exist in more 
than one of the sub-databases. Book records are the properties of the system described 
above. The fields created for these records were Title, Date, Authors, Publisher, plus 6 key- 
words describing the contents of the books. These keywords are the concepts of the system 
described above. Naturally, many of these keywords overlap. From the 150 books, 89 
keywords were identified. Thus the system has 89 concepts and 150 properties. Figure 4 
shows TalkMine's result screen. Two databases are selected S3.DBD and S4.DBD. In this 
case the initial concept to start the search was "ADAPTIVE SYSTEMS". The concepts (key- 
words) used in the question-answering process are shown in two different boxes for 
questions receiving 'YES" and "NO" responses respectively. 

TalkMine implements the contextual construction of short-term categories from several 
long-term relational structures as described above. It is based on prototypical categories 
represented by evidence sets defined in section 5. The long-term distributed memory 
structure implements the connectionist aspects of cognitive systems. It is this structure that 
ultimately dictates how categories are constructed. The categories constructed are short- 
term structures not stored in any location, but constructed "on the hoof 1 as the system 
relates its several sub-networks to the interaction (conversation) users provide. Its syntax is 
based on evidence sets and their extended theory of approximate reasoning. Semantics is 
established in accordance to the system's internal distributed semi-metrics, and how it 
pragmatically relates to the users needs. Furthermore, TalkMine explores contextual 
conflicting uncertainty as a source of artificial category construction, since the selection of 
concepts for the question-answering process is based on reducing the total uncertainty 
present in learned categories. More details about TalkMine can be found in Rocha [1997b]. 
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if Talk ftimz With Evidence set* 




ANDROIDS 

ARTIFICIAL INTELLIGENCE 

ARTIFICIAL LIFE 

ASSOCIATIVE STORAGE 

BIOLOGY 

BODY 

BRAIN 

CATEGORIZATION 

CELLULAR AUTOMATA 

CHAOS 

COGNITION 

COMPLEX SYS 1 EMS 

COMPUTER GRAPHICS 

COMPUTER NETWORKS 

CONNEC110NESM 

CONSCIOUSNESS 

CONSTRUCTIVISM 

CONTEXT 

CONTROL 

CYBERNETICS 

DECONSTRUCTION 

DEVELOPMENT 



Figure 3: TalkMine's search screen 



10 Evidence Sets as a system of Recontextualization of 
Categories 

The evidence set question-answering system of section 9 models the construction of the 
prototypical effects discussed in section 4. Such "on the hoof" construction of categories 
triggered by interaction with users, allows several distributed networks to be searched 
simultaneously, temporarily generating categories that are not really stored in any location. 
The short-term categories bridge together a number of possibly unrelated contexts, which in 
turn creates new associations in the individual databases that would never occur within 
their own limited context. Therefore, the construction of short-term linguistic categories in 
this artificial system, implements a sort of structural perturbation of long-term distributed 
associations. It is in fact a system of recontextualization of otherwise contextually 
constrained, independent distributed networks. 

This transference of information across dissimilar contexts through short-term, 
categorization models some aspects of what metaphor offers to human cognition: the ability 
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to discern correspondence in non-similar concepts [Holyoak and Thagard, 1995; Henry, 
1995]- Consider the following example. Two distinct databases are going to be searched 
using the system described above. One database contains the books of an institution devoted 
to the study of computational complex adaptive systems (e.g. the library of the Santa Fe 
Institute), and the other the books of a Philosophy of Biology department . I am interested 
in the concepts of Genetics and Natural Selection. If I were to conduct this search a number 
of times, due to my own interests, the learned category obtained would certainly contain 
other concepts such as Adaptive Computation, Genetic Algorithms, etc. Let me assume that 
the concept of Genetic Algorithms does not initially exist in the Philosophy of Biology 
library. After I conduct this search a number of times, the concept of Genetic Algorithms is 
created in this library, even though it does not contain any books in this area. However, with 
my continuing to perform this search over and over again, the concept of Genetic 
Algorithms becomes highly associated with Genetics and Natural Selection, in a sense 
establishing a metaphor for these concepts. From this point on, users of the Philosophy of 
Biology library, by entering the keyword Genetic Algorithms would have their own data 
retrieval system output books ranging from "The Origin of Species" to treatises on Neo- 
Darwinism - at which point they would probably bar me from using their networked 
database! Because of the Evidence Set system of short-term categorization that uses 
existing, fairly contextually independent distributed sub-networks, an ability to create 
correspondence between somewhat unrelated concepts is established. 

Given a large number of sub-networks comprised of context-specific associations, the 
categorization system is able to create new categories that are not stored in any one location, 
changing the long-term memory banks in an open-ended fashion. Thus the linguistic 
categorization Evidence Set mechanism implements a system of open-ended structural 
perturbation of long-term networked memory. Open-endedness does not mean that the 
categorizing system is able to discern all possible details of its user environment, but that it 
can permutate all the associative information that it constructs in an open-ended manner. 
Each independent network has the ability to associate new knowledge in its own context 
(e.g. as more books are added to the libraries of the prior examples). To this, the 
categorization scheme adds the ability of open-ended associations built across networks and 
contexts. Therefore, a linguistic categorization mechanism as defined above, offers the 
ability to recontextualize lower level distributed memory banks, according to a pragmatic, 
consensual, interaction with an environment. 
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Footnotes 

1. The membership value of an element of an evidence set is independent of the membership 
values of others elements contained in the set, 

2. This measure of distance calculated in a large network of nodes, is usually not a Euclidean 
metric because it does not observe the triangular inequality. In-other words, the shortest 
distance between two nodes of the network might not be the direct path. This means that 



http://www.c3. lanl.gov/-rocha/esijgs.html 



4/21/04 



Evidence Sets: Modelling Subjective Categories 



Page 29 of 29 



two nodes may be closer to each other when another node is associated with them. Such 
measures of distance are referred to as semi-metrics [Galvin and Shore, 1991]. 
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